Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Document the /v1/models endpoint#42588

Open
LysandreJik wants to merge 1 commit into
mainfrom
document-serve-models
Open

Document the /v1/models endpoint#42588
LysandreJik wants to merge 1 commit into
mainfrom
document-serve-models

Conversation

@LysandreJik

Copy link
Copy Markdown
Member

No description provided.

@LysandreJik LysandreJik requested a review from Wauplin December 3, 2025 10:51
Comment thread docs/source/en/serving.md
The easiest way to download models to your cache is with the `hf download` command:

```shell
hf download <model_id>

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually this will download all the files (even "original" files), so there is probably a better way

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe it would make sense to expose a utility that would only download the transformers-specific files

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do you mean something like transformers download ? If only it existed... 😛

Image

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
hf download <model_id>
transformers download <model_id>

@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Comment thread docs/source/en/serving.md
The easiest way to download models to your cache is with the `hf download` command:

```shell
hf download <model_id>

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
hf download <model_id>
transformers download <model_id>

Comment thread docs/source/en/serving.md
### Available models

The `/v1/models` endpoint scans your local cache for generative models. It checks for LLMs as well as VLMs.
The easiest way to download models to your cache is with the `hf download` command:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
The easiest way to download models to your cache is with the `hf download` command:
The easiest way to download models to your cache is with the `transformers download` command:

Comment thread docs/source/en/serving.md
hf download <model_id>
```

As long as it's a transformers-compatible LLM/VLM, it will now show up under `/v1/models`

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
As long as it's a transformers-compatible LLM/VLM, it will now show up under `/v1/models`
Once downloaded, the model will show up under `/v1/models`.

@stevhliu stevhliu left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice! This adds more context than my current docs for v1/models here.

Maybe we can combine the two to also show how to curl the v1/models endpoint for a more complete end-to-end example?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants