Code

Add beam search#631

Code

Open

mattpulver wants to merge 2 commits intoabetlen:mainabetlen/llama-cpp-python:mainfrom

heavyai:add_beam_searchheavyai/llama-cpp-python:add_beam_searchCopy head branch name to clipboard

Commits

Commits on Sep 19, 2023

• Add beam search. Invoke by adding "beam_search": 2 (for example) to /v1/completions POST.

  mattpulver

  committed
  8044fd8

  Copy full SHA for 8044fd8

• Change default setting for logits_all from True to False.

  mattpulver

  committed
  3fce944

  Copy full SHA for 3fce944