Pinned Loading

1. kubernetes-sigs/inference-perf kubernetes-sigs/inference-perf Public

   GenAI inference performance benchmarking tool

   Python 106 44

2. llm-d-benchmark llm-d-benchmark Public

   Forked from llm-d/llm-d-benchmark

   llm-d benchmark scripts and tooling

   Jupyter Notebook

3. kubernetes-sigs/wg-serving kubernetes-sigs/wg-serving Public

   WG Serving

   Shell 30 21

4. open-telemetry/semantic-conventions open-telemetry/semantic-conventions Public

   Defines standards for generating consistent, accessible telemetry across a variety of domains

   Open Policy Agent 444 275

5. kubernetes/cloud-provider-gcp kubernetes/cloud-provider-gcp Public

   cloud-provider-gcp contains several projects used to run Kubernetes in Google Cloud

   Go 142 244

6. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 60.9k 10.7k