Thanks to visit codestin.com
Credit goes to github.com
Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
lukymole
/
llama-cpp-python
Public
forked from
JamePeng/llama-cpp-python
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Branch selector
main
User selector
All users
Datepicker
All time
Commit history
Commits on May 4, 2026
Bump version to 0.3.38
Show description for ef27f33
JamePeng
committed
ef27f33
View commit details
Copy full SHA for ef27f33
Browse repository at this point
Update Submodule vendor/llama.cpp 63d93d1..e48034d
Show description for fe8657a
JamePeng
committed
fe8657a
View commit details
Copy full SHA for fe8657a
Browse repository at this point
patch(logger): filter out verbose noisy CUDA Graph debug logs
Show description for 22a7fdb
JamePeng
committed
22a7fdb
View commit details
Copy full SHA for 22a7fdb
Browse repository at this point
perf: Optimize detokenize buffer sizing for CJK-heavy outputs
Show description for a63f60e
JamePeng
committed
a63f60e
View commit details
Copy full SHA for a63f60e
Browse repository at this point
Commits on May 3, 2026
Update /docs/wiki/index.md
Show description for de5a1e8
JamePeng
committed
de5a1e8
View commit details
Copy full SHA for de5a1e8
Browse repository at this point
docs: add `LlamaGrammar` wiki page
Show description for d7ed189
JamePeng
committed
d7ed189
View commit details
Copy full SHA for d7ed189
Browse repository at this point
feat(grammar): sync JSON schema to GBNF converter with upstream
Show description for 5336947
JamePeng
committed
5336947
View commit details
Copy full SHA for 5336947
Browse repository at this point
Commits on May 2, 2026
Bump version to 0.3.37
Show description for fe38cbf
JamePeng
committed
fe38cbf
View commit details
Copy full SHA for fe38cbf
Browse repository at this point
Update Submodule vendor/llama.cpp b97ebdc..63d93d1
JamePeng
committed
374c0d0
View commit details
Copy full SHA for 374c0d0
Browse repository at this point
docs: Update /docs/wiki/index.md
Show description for 28f842c
JamePeng
committed
28f842c
View commit details
Copy full SHA for 28f842c
Browse repository at this point
Update /docs/wiki/contributing-to-wiki.md
JamePeng
committed
cbf15da
View commit details
Copy full SHA for cbf15da
Browse repository at this point
Upload /docs/wiki/modules/LlamaSpeculative.md for llama_speculative.py
Show description for 50aafd4
JamePeng
committed
50aafd4
View commit details
Copy full SHA for 50aafd4
Browse repository at this point
docs: update LLM wiki schema to v0.3
Show description for 4e58a63
JamePeng
committed
4e58a63
View commit details
Copy full SHA for 4e58a63
Browse repository at this point
Update docs/wiki/modules/LlamaCache.md and Separate the modules folder
JamePeng
committed
ef618a6
View commit details
Copy full SHA for ef618a6
Browse repository at this point
Update Submodule vendor/llama.cpp 660b1b4..b97ebdc
JamePeng
committed
b875c9a
View commit details
Copy full SHA for b875c9a
Browse repository at this point
Commits on May 1, 2026
Update /docs/wiki/Llama.md
JamePeng
committed
120c5e2
View commit details
Copy full SHA for 120c5e2
Browse repository at this point
Update README.md
JamePeng
committed
cfa0158
View commit details
Copy full SHA for cfa0158
Browse repository at this point
Commits on Apr 30, 2026
feat(llama): add fine-grained MoE CPU offloading controls
Show description for b7064d7
JamePeng
committed
b7064d7
View commit details
Copy full SHA for b7064d7
Browse repository at this point
feat(_ggml): implement ggml-backend API bindings and fix type hints
Show description for 66dd88b
JamePeng
committed
66dd88b
View commit details
Copy full SHA for 66dd88b
Browse repository at this point
Update Submodule vendor/llama.cpp 4414c04..660b1b4
JamePeng
committed
db8bf45
View commit details
Copy full SHA for db8bf45
Browse repository at this point
Commits on Apr 27, 2026
feat(handler): Support `add_generation_prompt` parameter pass to MTMDChatHandler
Show description for 969b45f
JamePeng
committed
969b45f
View commit details
Copy full SHA for 969b45f
Browse repository at this point
Upload /docs/wiki/LlamaEmbedding.md for llama_embedding.py
Show description for 5068a80
JamePeng
committed
5068a80
View commit details
Copy full SHA for 5068a80
Browse repository at this point
Update Submodule vendor/llama.cpp b760272..4414c04
JamePeng
committed
9d23199
View commit details
Copy full SHA for 9d23199
Browse repository at this point
Commits on Apr 26, 2026
Update README.md
Show description for 820d183
JamePeng
committed
820d183
View commit details
Copy full SHA for 820d183
Browse repository at this point
Update /docs/wiki/core/Llama.md for abort() and example code
Show description for 7a4dd5b
JamePeng
committed
7a4dd5b
View commit details
Copy full SHA for 7a4dd5b
Browse repository at this point
feat(core): implement thread-safe generation abort mechanism
Show description for 2cccd2e
JamePeng
committed
2cccd2e
View commit details
Copy full SHA for 2cccd2e
Browse repository at this point
Update Submodule vendor/llama.cpp 13d36cf..b760272
JamePeng
committed
3ec636d
View commit details
Copy full SHA for 3ec636d
Browse repository at this point
Commits on Apr 24, 2026
feat(speculative): introduce O(1) hash-based N-Gram speculative decoding
Show description for ddf577d
JamePeng
committed
ddf577d
View commit details
Copy full SHA for ddf577d
Browse repository at this point
Update Submodule vendor/llama.cpp 8bccdbb..13d36cf
JamePeng
committed
7a02d4d
View commit details
Copy full SHA for 7a02d4d
Browse repository at this point
Commits on Apr 22, 2026
Update /docs/wiki/core/Llama.md
Show description for 852a2e9
JamePeng
committed
852a2e9
View commit details
Copy full SHA for 852a2e9
Browse repository at this point
feat(types): introduce MCP definitions and align with latest OpenAI spec
Show description for afd038f
JamePeng
committed
afd038f
View commit details
Copy full SHA for afd038f
Browse repository at this point
Update Submodule vendor/llama.cpp 82209ef..8bccdbb
JamePeng
committed
dbb7407
View commit details
Copy full SHA for dbb7407
Browse repository at this point
Commits on Apr 21, 2026
Update Submodule vendor/llama.cpp 81df3f7..82209ef
JamePeng
committed
8625836
View commit details
Copy full SHA for 8625836
Browse repository at this point
Commits on Apr 20, 2026
Update Submodule vendor/llama.cpp 037bfe3..81df3f7
JamePeng
committed
e3b7ad6
View commit details
Copy full SHA for e3b7ad6
Browse repository at this point
Commits on Apr 19, 2026
docs: initialize LLM Wiki structure for better documentation maintenance
Show description for 15f8a36
JamePeng
committed
15f8a36
View commit details
Copy full SHA for 15f8a36
Browse repository at this point
Previous
Next
You can’t perform that action at this time.