Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Commit c61b70b

Browse files
committed
fix parsed_completion_tokens
1 parent 3b95c79 commit c61b70b

File tree

1 file changed

+11
-0
lines changed

1 file changed

+11
-0
lines changed

‎langfuse/openai.py‎

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -408,6 +408,12 @@ def _get_langfuse_data_from_kwargs(resource: OpenAiDefinition, kwargs: Any) -> A
408408
else float("inf")
409409
)
410410

411+
parsed_max_completion_tokens = (
412+
kwargs.get("max_completion_tokens", None)
413+
if not isinstance(kwargs.get("max_completion_tokens", float("inf")), NotGiven)
414+
else None
415+
)
416+
411417
parsed_top_p = (
412418
kwargs.get("top_p", 1)
413419
if not isinstance(kwargs.get("top_p", 1), NotGiven)
@@ -441,6 +447,11 @@ def _get_langfuse_data_from_kwargs(resource: OpenAiDefinition, kwargs: Any) -> A
441447
"frequency_penalty": parsed_frequency_penalty,
442448
"presence_penalty": parsed_presence_penalty,
443449
}
450+
451+
if parsed_max_completion_tokens is not None:
452+
modelParameters.pop("max_tokens", None)
453+
modelParameters["max_completion_tokens"] = parsed_max_completion_tokens
454+
444455
if parsed_n is not None and parsed_n > 1:
445456
modelParameters["n"] = parsed_n
446457

0 commit comments

Comments
 (0)