Thanks to visit codestin.com
Credit goes to github.com

Skip to content

[cli] report all quant backends in diffusers-cli env.#13728

Merged
sayakpaul merged 6 commits into
mainfrom
report-quant-backends-cli
Jun 8, 2026
Merged

[cli] report all quant backends in diffusers-cli env.#13728
sayakpaul merged 6 commits into
mainfrom
report-quant-backends-cli

Conversation

@sayakpaul

@sayakpaul sayakpaul commented May 12, 2026

Copy link
Copy Markdown
Member

What does this PR do?

Report all quantization backends in diffusers-cli env to make it more comprehensive. It now unfolds to something like:

Copy-and-paste the text below in your GitHub issue and FILL OUT the two last points.

- 🤗 Diffusers version: 0.39.0.dev0
- Platform: Linux-5.15.0-1048-aws-x86_64-with-glibc2.31
- Running on Google Colab?: No
- Python version: 3.12.12
- PyTorch version (GPU?): 2.11.0+cu129 (True)
- Flax version (CPU?/GPU?/TPU?): not installed (NA)
- Jax version: not installed
- JaxLib version: not installed
- Huggingface_hub version: 1.11.0
- Transformers version: 5.6.0.dev0
- Accelerate version: 1.12.0
- PEFT version: 0.18.2.dev0
- bitsandbytes version: 0.49.0
- gguf version: 0.19.0
- optimum-quanto version: not installed
- torchao version: 0.17.0
- nvidia-modelopt version: not installed
- Safetensors version: 0.7.0
- xFormers version: not installed
- Accelerator: NVIDIA H100 80GB HBM3, 81559 MiB
- Using GPU in script?: <fill in>
- Using distributed or parallel set-up in script?: <fill in>

@github-actions github-actions Bot added utils size/S PR with diff < 50 LOC labels May 12, 2026
@sayakpaul sayakpaul requested review from DN6 and yiyixuxu May 12, 2026 09:11
import bitsandbytes

bitsandbytes_version = bitsandbytes.__version__
quantization_versions = {}

@DN6 DN6 May 13, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the backend isn't available, I'd say it's better to skip adding it to the final message entirely. Keeps the logs less noisy.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@sayakpaul sayakpaul requested a review from DN6 May 13, 2026 09:01
@sayakpaul sayakpaul merged commit 41875e0 into main Jun 8, 2026
15 of 16 checks passed
@sayakpaul sayakpaul deleted the report-quant-backends-cli branch June 8, 2026 12:33
DN6 pushed a commit that referenced this pull request Jul 1, 2026
* report all quant backends in diffusers-cli env.

* reduce reporting noise
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size/S PR with diff < 50 LOC utils

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants