Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Add tensor parallelism support for int4_weight_only quantization#1120

Merged
jerryzh168 merged 2 commits intopytorch:mainfrom
jerryzh168:int4wo-tp
Oct 19, 2024
Merged

Add tensor parallelism support for int4_weight_only quantization#1120
jerryzh168 merged 2 commits intopytorch:mainfrom
jerryzh168:int4wo-tp

Commits

Commits on Oct 18, 2024