Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Commit 45de9d5

Browse files
committed
feat: Update llama.cpp
1 parent 7aaf701 commit 45de9d5

File tree

2 files changed

+9
-1
lines changed

2 files changed

+9
-1
lines changed

llama_cpp/llama_cpp.py

+8
Original file line numberDiff line numberDiff line change
@@ -1505,6 +1505,14 @@ def llama_model_has_encoder(model: llama_model_p, /) -> bool:
15051505
...
15061506

15071507

1508+
# // Returns true if the model contains a decoder that requires llama_decode() call
1509+
# LLAMA_API bool llama_model_has_decoder(const struct llama_model * model);
1510+
@ctypes_function("llama_model_has_decoder", [llama_model_p_ctypes], ctypes.c_bool)
1511+
def llama_model_has_decoder(model: llama_model_p, /) -> bool:
1512+
"""Returns true if the model contains a decoder that requires llama_decode() call"""
1513+
...
1514+
1515+
15081516
# // For encoder-decoder models, this function returns id of the token that must be provided
15091517
# // to the decoder to start generating output sequence. For other models, it returns -1.
15101518
# LLAMA_API llama_token llama_model_decoder_start_token(const struct llama_model * model);

vendor/llama.cpp

0 commit comments

Comments
 (0)