Popular repositories Loading

1. MX-QLLM MX-QLLM Public

   LLM Inference with Microscaling Format

   Python 31 3

2. Attention-Head-Pruning Attention-Head-Pruning Public

   Layer-wise Pruning of Transformer Heads for Efficient Language Modeling

   Python 22

3. TSLD TSLD Public

   [NeurIPS 2023] Token-Scaled Logit Distillation for Ternary Weight Generative Language Models

   Python 18 1

4. TernGEMM TernGEMM Public

   TernGEMM: General Matrix Multiply Library with Ternary Weights for Fast DNN Inference

   C++ 13 1

5. AI-thermometer AI-thermometer Public

   Python 9 2

6. COCO-dataset-based-light-weight-fast-object-detection-model COCO-dataset-based-light-weight-fast-object-detection-model Public

   Python 8