Kubernetes AI Toolchain Operator

Evaluating an inference stack built on top of KAITO and llm-d.

✈️ Kubernetes-native platform for deploying and managing AI inference across multiple providers

A Keda external scaler for Kaito resource without depending on the third-party components(like prometheus)

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

A kubectl plugin for deploying and managing AI/ML models using Kaito.

Examples and guides for using the Kaito API