Popular repositories Loading

1. Token-Intercept Token-Intercept Public

   Intercept OpenAI's FastAPI and re-route requests to a local vLLM server. (future TRT-LLM support planned)

   Python 2

2. Transformer-ports Transformer-ports Public

   C 1

3. bsd3-mac-llm-ui bsd3-mac-llm-ui Public

   C 1

4. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++

5. Mediated-Light-Emitting-Diode Mediated-Light-Emitting-Diode Public

   C

6. Python-Native-libCuFile Python-Native-libCuFile Public

   Python