Roadmap for v0.2 #487

New issue

Copy link

New issue

Copy link

Open

Open

Roadmap for v0.2#487

Copy link

Labels

documentationImprovements or additions to documentationImprovements or additions to documentationenhancementNew feature or requestNew feature or request

Description

abetlen

opened on Jul 18, 2023

Issue body actions

• Migrate project to scikit-build-core #489
• Simplify dev / local setup using pyproject.toml and makefile #490
• Use numpy arrays for LogitsProcessors and StopCriteria to avoid copies / allocations #491
• Llama2 #488
• Configurable chat templates #492
• Add support for OpenAI-style functions #494
• Expose scores and input_ids in Llama model #493
• Add batched inference #771
• Speculative sampling #675

Reactions are currently unavailable

Metadata

Metadata

Assignees

No one assigned

Labels

documentationImprovements or additions to documentationImprovements or additions to documentationenhancementNew feature or requestNew feature or request

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions