Thanks to visit codestin.com
Credit goes to github.com

Commits

Commits on Jul 28, 2025

Update README.md (#262)
wisman-tccr
authored

Commits on Jul 27, 2025

Commits on Feb 19, 2025

Commits on Sep 6, 2024

Fix segmentation fault for models exceeding 40B on AMD GPUs & optimize mul_mat_axpy operation (#217)

Tworan
and
tworan
authored

Commits on Jul 1, 2024

add convert-hf-to-powerinfer-gguf.py to CMakeLists.txt (#205)
MatthewCroughan
authored

Commits on Jun 27, 2024

Update README (#204)
jeremyyx
authored

Commits on Jun 11, 2024

minor in README(#193)
jeremyyx
authored
add news (#192)

jeremyyx
and
hodlen
authored

Commits on May 20, 2024

Support AMD ROCm(#187)

freelulul
and
hodlen
authored

Commits on Apr 7, 2024

fix: offload ffn norm weights (#179)
hodlen
authored

Commits on Apr 2, 2024

Commits on Mar 28, 2024

Support Bamboo LM sparse and dense inference (#171)
hodlen
authored

Commits on Mar 27, 2024

Commits on Mar 17, 2024

Full-GPU computational graph and CUDA refactoring (#153)
hodlen
authored

Commits on Mar 14, 2024

Add prosparse to README (#149)

Raincleared-Song
and
hodlen
authored

Commits on Mar 7, 2024

fix: unknown host compiler flags passed to nvcc (#161)
hodlen
authored

Commits on Feb 20, 2024

Fix compiling issue under git worktrees (#146)
hodlen
authored

Commits on Feb 18, 2024

Fix CMake requirement in README (#145)
hodlen
authored

Commits on Feb 1, 2024

Commits on Jan 30, 2024

Docs: add detailed instruction on downloading HF models (#136)
hodlen
authored

Commits on Jan 26, 2024

Commits on Jan 24, 2024

Commits on Jan 11, 2024

Support CPU/GPU inference on Windows (#114)

hodlen
and
zwb
authored

Commits on Jan 4, 2024

Convert HF models with sparse threshold specified (#76)
Szy0127
authored

Commits on Jan 3, 2024

Commits on Dec 29, 2023

Support setting VRAM budget for `examples/server` (#106)
hodlen
authored