Search results

Question: How to convert quantized model output to a .safetensor file for Hugging Face?

Status: Open.

#58 In Vahe1994/SpQR;

· gapsong opened on Oct 24, 2025

Why setting <code>bos_token_id</code> to <code>1</code>?

Status: Open.

#56 In Vahe1994/SpQR;

· horizon86 opened on Dec 18, 2024

when use --load to load quantized model, the quantized weight is not correct ??

Status: Open.

#48 In Vahe1994/SpQR;

· HueCheng1021 opened on Sep 24, 2024

when I reference, is it much slower since I need if else to see which precision to dequantize?

Status: Open.

#46 In Vahe1994/SpQR;

· LiMa-cas opened on Jul 26, 2024

Which dataset should I use?

Status: Open.

#39 In Vahe1994/SpQR;

· ccccj opened on Nov 7, 2023

CUDA out of memory falcon-40b when using 40Gi A100 GPU

Status: Open.

#22 In Vahe1994/SpQR;

· caleb-artifact opened on Jul 5, 2023

Process killed after eval phase

Status: Open.

#21 In Vahe1994/SpQR;

· Iambestfeed opened on Jul 3, 2023

Post Quantization for nllb-models

Status: Open.

#19 In Vahe1994/SpQR;

· Arnab1181412 opened on Jun 23, 2023

Evaluation code for Falcon models

Status: Open.

#17 In Vahe1994/SpQR;

· Amshaker opened on Jun 20, 2023

[ptb perplexity is different from paper]

Status: Open.

#16 In Vahe1994/SpQR;

· Amshaker opened on Jun 20, 2023

Provide SpQR trained model weights on OpenLLaMA?

Status: Open.

#15 In Vahe1994/SpQR;

· jayxsinha opened on Jun 20, 2023

SqueezeLLM

Status: Open.

#14 In Vahe1994/SpQR;

· Iambestfeed opened on Jun 16, 2023