An Open Source Machine Learning Framework for Everyone

LLM inference in C/C++

A fast and easy-to-use status bar

Tensor library for machine learning

High-speed Large Language Model Serving for Local Deployment

TTS support with GGML

Metal GPU implementation of the Qwen3 transformer model on macOS with complete Apple Silicon compute shader acceleration.

Zero Dependency LibTorch Safetensors Loading and Storing in C++