Thanks to visit codestin.com
Credit goes to github.com

LLM-devops / LLM-streaming-fastapi Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Streaming implementation of LLM inference using fastapi & hugging face

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 10 Commits
Dockerfile		Dockerfile
README.md		README.md
app.py		app.py
config.py		config.py
generator.py		generator.py
requirements.txt		requirements.txt
streamer.py		streamer.py
utils.py		utils.py

Repository files navigation

LLM-streaming-fastapi

Streaming implementation of LLM inference using fastapi & hugging face

About

Streaming implementation of LLM inference using fastapi & hugging face

Custom properties

Report repository

Releases

No releases published

Packages

No packages published

Languages