Thanks to visit codestin.com
Credit goes to github.com

Skip to content
This repository was archived by the owner on Jun 3, 2025. It is now read-only.

[Text Gen UX] Add prompt as input param alias#1270

Merged
bfineran merged 1 commit into
mainfrom
text-gen-prompt-alias
Sep 25, 2023
Merged

[Text Gen UX] Add prompt as input param alias#1270
bfineran merged 1 commit into
mainfrom
text-gen-prompt-alias

Conversation

@bfineran

@bfineran bfineran commented Sep 25, 2023 •
edited
Loading

Copy link
Copy Markdown
Contributor

from internal specs:

text_pipeline = TextGeneration(model=MODEL, **kwargs)
text_result = text_pipeline(prompt=PROMPT, **kwargs)

test_plan:
local

from deepsparse import Pipeline

pipeline = Pipeline.create(
    "text-generation",
    model_path="/home/benjamin/neuralmagic/models/codegen_mono-350m-bigpython_bigquery_thepile-pruned50/deployment",
    engine_type="onnxruntime"
)

pipeline(prompt="def hello_world():", generation_config=dict(max_new_tokens=10))

@bfineran
[Text Gen UX] Add prompt as input param alias
a0f4927 
from internal specs:

```python
text_pipeline = TextGeneration(model=MODEL, **kwargs)
text_result = text_pipeline(prompt=PROMPT, **kwargs)
```
@bfineran bfineran requested a review from dsikka September 25, 2023 13:39
@bfineran bfineran self-assigned this Sep 25, 2023
@bfineran

bfineran commented Sep 25, 2023

Copy link
Copy Markdown
Contributor Author

tests unrelated - sparsezoo compression issues

@bfineran bfineran merged commit 51a0a7b into main Sep 25, 2023
@bfineran bfineran deleted the text-gen-prompt-alias branch September 25, 2023 15:07
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

2 more reviewers

@mgoin mgoin mgoin approved these changes

@dsikka dsikka dsikka approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

@bfineran bfineran

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@bfineran @mgoin @dsikka