Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Issues: abetlen/llama-cpp-python

Roadmap for v0.2
#487 opened Jul 18, 2023 by abetlen
Open 1
Add batched inference
#771 opened Sep 30, 2023 by abetlen
Open 37
Improve installation process
#1178 opened Feb 12, 2024 by abetlen
Open 8
Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

547 Open 708 Closed
547 Open 708 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Macos wheel fails on 0.35, works on 0.34
#2016 opened May 9, 2025 by Alex-EEE
Is llama-cpp-python supports Llama-4?
#2014 opened May 5, 2025 by rbgo404
Can't install with GPU support with Cuda toolkit 12.9 and Cuda 12.9
#2013 opened May 5, 2025 by hunainahmedj
How to install the latest version with GPU support
#2012 opened May 2, 2025 by shigabeev
1
llama-cpp-python 0.3.8 with CUDA
#2010 opened May 1, 2025 by SeBL4RD
2
LLAMA Compiling with Vulkan
#2006 opened Apr 27, 2025 by LaKanDoR
Segmentation fault (core dumped) appearing randomly
#2005 opened Apr 25, 2025 by AleefBilal
2
TypeError: 'NoneType' object is not callable in __del__() when exiting
#2002 opened Apr 12, 2025 by gbutiri
4 tasks done
Safeerchalil:codespace-automatic-barnacle-5gv4qx4j775wf47g
#2000 opened Apr 11, 2025 by Safeerchalil
How to use *chat_template* with .gguf models ? (tokenizer_name not implemented)
#1999 opened Apr 11, 2025 by Bobchenyx
Running basic example from docs results in TypeError: 'NoneType' object is not callable
#1998 opened Apr 11, 2025 by nchammas
4 tasks done
Wrong chat_format documented for Moondream 2
#1996 opened Apr 9, 2025 by joaopalmeiro
Llama 4 not working
#1994 opened Apr 8, 2025 by Kenshiro-28
8
Incorrect winmode in load_shared_library
#1993 opened Apr 8, 2025 by LucaBenini
Code completion via GitHub Copilot and Replit broken
#1992 opened Apr 4, 2025 by TheNotary
cu118 install falls back to CPU mode on CentOS 7 (0.3.8)
#1990 opened Apr 3, 2025 by ju-ing
Intel Mac (i9 - 5500M) (macOS 15.3.2) - ValueError: Failed to create llama_context - llama_init_from_model: failed to initialize Metal backend
#1988 opened Mar 29, 2025 by starkAhmed43
4 tasks done
1
CUDA llama-cpp-python build failed.
#1986 opened Mar 27, 2025 by Ado012
4
Stream last block not return token usage info when create_chat_completion_openai_v1 or create_chat_completion but server does
#1984 opened Mar 27, 2025 by hh23485
4 tasks done
1
Slow when logits_all=True, inconsistent logprobs and solutions
#1983 opened Mar 26, 2025 by For-rest2005
6
HIP enabled binary, or allow me to replace with my own llama binary
#1982 opened Mar 25, 2025 by madprops
Set GGML_BUILD_NUMBER to the correct version when building from pypi tarball
#1979 opened Mar 22, 2025 by booxter
4 tasks done
1
Gemma3 Multimodal
#1976 opened Mar 19, 2025 by JamesBVMNetwork
3
How to predict a specific length of tokens?
#1975 opened Mar 19, 2025 by simmonssong
3
Support for Python 3.13 in llama-cpp-python?
#1970 opened Mar 12, 2025 by JeevanEagala
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.