-
sglang Public
Forked from sgl-project/sglangSGLang is a fast serving framework for large language models and vision language models.
Python Apache License 2.0 UpdatedFeb 19, 2025 -
gpustack Public
Forked from gpustack/gpustackManage GPU clusters for running AI models
Python Apache License 2.0 UpdatedFeb 17, 2025 -
ktransformers Public
Forked from kvcache-ai/ktransformersA Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
Python Apache License 2.0 UpdatedFeb 16, 2025 -
-
d2l-zh Public
Forked from d2l-ai/d2l-zh《动手学深度学习》:面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。
Python Apache License 2.0 UpdatedJul 30, 2024 -
vllm Public
Forked from vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs
Python Apache License 2.0 UpdatedJul 25, 2024 -
llama.cpp Public
Forked from ggml-org/llama.cppLLM inference in C/C++
C++ MIT License UpdatedJul 25, 2024 -
open-webui Public
Forked from open-webui/open-webuiUser-friendly WebUI for LLMs (Formerly Ollama WebUI)
Svelte MIT License UpdatedJul 25, 2024 -
ollama Public
Forked from ollama/ollamaGet up and running with Llama 3, Mistral, Gemma 2, and other large language models.
Go MIT License UpdatedJul 23, 2024 -
attackgen Public
Forked from mrwadams/attackgenAttackGen is a cybersecurity incident response testing tool that leverages the power of large language models and the comprehensive MITRE ATT&CK framework. The tool generates tailored incident resp…
-
SecGPT Public
Forked from Clouditera/SecGPTSecGPT网络安全大模型
Python Apache License 2.0 UpdatedMay 8, 2024 -