Thanks to visit codestin.com
Credit goes to github.com

Name		Name	Last commit message	Last commit date
parent directory ..
components		components
routes		routes
README.md		README.md
__init__.py		__init__.py
_deps.py		_deps.py
application.py		application.py
benchmark_client.py		benchmark_client.py
cli.py		cli.py
client.py		client.py
server.py		server.py

README.md

LLM Server and CLI

This directory contains an LLM inference server, CLI and support components.

Quick start

python -m shortfin_apps.llm.server --help