Thanks to visit codestin.com
Credit goes to github.com

Skip to content

shayne-snap/llmpole

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

llmpole

中文

CI License: MIT

LLM Pole — find your pole-position models. A terminal tool that right-sizes LLM models to your system's RAM, CPU, and GPU. It detects your hardware, scores each model on quality, speed, fit, and context, and tells you which ones will actually run well on your machine. Ships with an interactive TUI (default) and a classic CLI mode. Supports multi-GPU setups, MoE architectures, dynamic quantization selection, and speed estimation.

Demo

TUI (default — interactive browser):

TUI Demo

CLI (table output with --cli and subcommands):

CLI Demo

Installation

One-line install (downloads the latest release and installs to /usr/local/bin or ~/.local/bin):

curl -fsSL https://raw.githubusercontent.com/shayne-snap/llmpole/main/install.sh | sh

From source (requires Go 1.24+):

go install github.com/shayne-snap/llmpole@latest

Ensure $GOPATH/bin or $HOME/go/bin is in your PATH.

Usage

  • --version, -v — print version and exit.
  • No arguments — starts the interactive TUI to browse models that fit your system.
  • --cli — use table output instead of TUI when running with no subcommand.
  • --json — output results as JSON where supported.
  • --limit, -n — limit number of results (e.g. -n 10).
  • --perfect — show only models that perfectly match recommended specs.

Commands

Command Description
system Show system hardware (RAM, CPU, GPU).
list List all LLM models.
pole Pole/adaptation analysis: models that fit your system, sorted by score.
search [query] Search models by name, provider, or size.
info [model] Show detailed info and fit for a model.
recommend Top recommendations for your hardware (options: --use-case, -n).
update-list Download the latest model list to your cache.

Examples

llmpole                    # TUI
llmpole --cli              # Table view
llmpole system             # Hardware summary
llmpole pole -n 5          # Top 5 fits
llmpole search llama       # Search by name
llmpole recommend -n 3     # Top 3 recommendations

Requirements

  • Go: 1.24+ for building from source.
  • Platforms: Linux (x86_64, aarch64), macOS (x86_64, arm64).

License

MIT. See LICENSE.

Contributing

See CONTRIBUTING.md for how to report issues, send PRs, and run the project locally.

About

Find which LLM models can run on your hardware

Resources

License

Contributing

Stars

3 stars

Watchers

0 watching

Forks

Packages

 
 
 

Contributors