-
Notifications
You must be signed in to change notification settings - Fork 12.4k
Open
Labels
enhancementNew feature or requestNew feature or requestgood first issueGood for newcomersGood for newcomershelp wantedNeeds help from the communityNeeds help from the communitysplitGGUF split model shardingGGUF split model sharding
Description
Context
When downloading a sharded model, files are downloaded in parallel, it was added in:
The progressions of each download conflict:
Need to properly implement CURLOPT_NOPROGRESS for parallel download.
Example in #6515:
main --hf-repo ggml-org/models \
--hf-file grok-1/grok-1-q4_0-00001-of-00009.gguf \
--model models/grok-1-q4_0-00001-of-00009.gguf \
-ngl 64
--prompt "I believe the meaning of life is"
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or requestgood first issueGood for newcomersGood for newcomershelp wantedNeeds help from the communityNeeds help from the communitysplitGGUF split model shardingGGUF split model sharding