Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
-
Updated
Oct 28, 2025 - Python
#
openvino-genai
Here are 2 public repositories matching this topic...
Just practising deploying MLM locally on my laptop
-
Updated
May 22, 2025 - Python
Improve this page
Add a description, image, and links to the openvino-genai topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the openvino-genai topic, visit your repo's landing page and select "manage topics."