allowed_tools
in OpenAI-compatible interface doesn't work when tools aren't declared in tensorzero.toml
#3546
ucirello
started this conversation in
Bug Reports
Replies: 1 comment 1 reply
-
Today, TensorZero assumes all dynamic tools are allowed. I agree we might want to change that; but that'll be a breaking change. Proposal For 1-2 releases, we should log After that:
The same behavior should be replicared for |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Possibly a continuation of #3469
Right now, I can have functions declared in
tensorzero.toml
whose tools are dynamically decided at inference time. I can set tool_choiceauto
,none
, andrequired
just fine. When I setallowed_tools
though, it only accepts tools that were declared intensorzero.toml
breaking my expectation that I would be able to manipulate them at inference time.Beta Was this translation helpful? Give feedback.
All reactions