Pinned Loading

1. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 1.9k 205

2. kserve/kserve kserve/kserve Public

   Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

   Python 4.7k 1.3k

3. llm-d/llm-d-inference-scheduler llm-d/llm-d-inference-scheduler Public

   Inference scheduler for llm-d

   Go 99 84

4. knative/eventing knative/eventing Public

   Event-driven application platform for Kubernetes

   Go 1.5k 617