Thanks to visit codestin.com
Credit goes to github.com

Skip to content
This repository was archived by the owner on Jun 3, 2025. It is now read-only.

[Add] sequence length to text gen pipelines#1518

Merged
rahul-tuli merged 2 commits into
mainfrom
add-sequence-length-to-text-gen-pipelines
Jan 9, 2024
Merged

[Add] sequence length to text gen pipelines#1518
rahul-tuli merged 2 commits into
mainfrom
add-sequence-length-to-text-gen-pipelines

Conversation

@rahul-tuli

@rahul-tuli rahul-tuli commented Jan 8, 2024

Copy link
Copy Markdown
Member

This PR exposes sequence_length as a Pipeline level property

Test Code:

from deepsparse import Pipeline

pipeline = Pipeline.create(
            task="text-generation",
            model_path="zoo:mpt-7b-mpt_pretrain-base_quantized",
        )

assert hasattr(pipeline, "sequence_length")

Was failing before, but passes after this PR

@rahul-tuli rahul-tuli self-assigned this Jan 8, 2024
@rahul-tuli rahul-tuli marked this pull request as ready for review January 8, 2024 19:57
@rahul-tuli rahul-tuli merged commit 5004edd into main Jan 9, 2024
@rahul-tuli rahul-tuli deleted the add-sequence-length-to-text-gen-pipelines branch January 9, 2024 13:11
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

@dsikka dsikka Awaiting requested review from dsikka

@horheynm horheynm Awaiting requested review from horheynm

@dbogunowicz dbogunowicz Awaiting requested review from dbogunowicz

2 more reviewers

@Satrat Satrat Satrat approved these changes

@bfineran bfineran bfineran approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

@rahul-tuli rahul-tuli

Labels

mle-team

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@rahul-tuli @Satrat @bfineran