-
-
Notifications
You must be signed in to change notification settings - Fork 658
Closed
Labels
Milestone
Description
Original idea: #776 (comment)
Idea:
llm logs --schema Xsearch option which figures out the ID of the schema you pass in and then returns all matching responses.I could add options to
llm logsfor outputting just the JSON response data - then you could run the same schema a bunch of times to collect data and dump that back out from the logs as CSV or JSON later on.Could even have a
--keyoption or similar so that if you logged a bunch of responses that were an object with a single key containing an array of objects those objects can be dumped out flattened together somehow.
PR: