Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )

No-code CLI designed for accelerating ONNX workflows

Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series

An interactive Ascend-NPU process viewer

Persist and reuse KV Cache to speedup your LLM.

将LLM 模型部署到 Rockchip Rk3588芯片中，在开发板上使用NPU进行推理

Run your yolov7 object detection with Rockchip NPU platforms (RK3566, RK3568, RK3588, RK3588S, RV1103, RV1106, RK3562).

EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

PyTorchSim is a Comprehensive, Fast, and Accurate NPU Simulation Framework

🐉 Revolutionary NPU framework for Linux | 24,988 FPS face recognition | AMD XDNA support | World's first complete NPU stack

A simple Python script for running LLMs on Intel's Neural Processing Units (NPUs)

Your models on any xPU

Superresolution running on Rockchip NPU (RK3588, etc..)

⚡ A seamless integration of HuggingFace Transformers & Diffusers with RBLN SDK for efficient inference on RBLN NPUs.

Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separate tools such as nvidia-smi or /proc/cpuinfo and parsing it yourself.

Python scripts performing Open Vocabulary Object Detection using the YOLO-World model in ONNX. And Export the ONNX model for AXera's NPU

Running Large Language Model easily.

CoreML conversion script for Bria-RMBG-1.4

Convert and run scikit-learn MLPs on Rockchip NPU.