Tools for merging pretrained large language models.

Preprint: Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

Accessible large language models via k-bit quantization for PyTorch.

[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.