An Ollama-style inference system with pluggable backends (vLLM, mistral.rs, llama.cpp).
-
Notifications
You must be signed in to change notification settings - Fork 0
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
License
akshat2602/Omistral
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
Topics
Resources
License
Stars
Watchers
Forks
Releases
No releases published