Thanks to visit codestin.com
Credit goes to github.com

Skip to content
This repository was archived by the owner on Jun 3, 2025. It is now read-only.

download compressed deployment directory#1318

Merged
bfineran merged 2 commits into
mainfrom
deployment-tar
Oct 17, 2023
Merged

download compressed deployment directory#1318
bfineran merged 2 commits into
mainfrom
deployment-tar

Conversation

@bfineran

@bfineran bfineran commented Oct 12, 2023 •
edited
Loading

Copy link
Copy Markdown
Contributor

to land with neuralmagic/sparsezoo#373

updates deployment directory downloads to target the compressed directory instead of loose files

simple test:

from deepsparse import Pipeline

pipeline = Pipeline.create(
    "text-generation",
    model_path="zoo:nlg/text_generation/mpt-7b/pytorch/huggingface/mpt_chat/base-none",
    engine_type="onnxruntime"
)

pipeline("test", generation_config=dict(max_new_tokens=10))

@bfineran bfineran self-assigned this Oct 12, 2023
@bfineran bfineran marked this pull request as ready for review October 12, 2023 20:39
@bfineran bfineran mentioned this pull request Oct 12, 2023
Merged
@bfineran bfineran merged commit 697752f into main Oct 17, 2023
@bfineran bfineran deleted the deployment-tar branch October 17, 2023 18:29
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

2 more reviewers

@mgoin mgoin mgoin approved these changes

@Satrat Satrat Satrat approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

@bfineran bfineran

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@bfineran @mgoin @Satrat