Popular repositories Loading

1. qlora qlora Public

   Forked from artidoro/qlora

   QLoRA: Efficient Finetuning of Quantized LLMs

   Jupyter Notebook

2. QIGen QIGen Public

   Forked from IST-DASLab/QIGen

   Repository for CPU Kernel Generation for LLM Inference

   Python

3. RPTQ4LLM RPTQ4LLM Public

   Forked from hahnyuan/RPTQ4LLM

   Reorder-based post-training quantization for large language model

   Python

4. smoothquant smoothquant Public

   Forked from mit-han-lab/smoothquant

   [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

   Python

5. gptq gptq Public

   Forked from IST-DASLab/gptq

   Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

   Python

6. bit bit Public

   Forked from facebookresearch/bit

   Code repo for the paper BiT Robustly Binarized Multi-distilled Transformer

   Python