Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Conversation

@shuyangli
Copy link
Member

@shuyangli shuyangli commented Dec 20, 2025

  • Added a new endpoint /internal/evaluations/statistics that returns aggregated statistics (mean, confidence intervals) for specified evaluation runs and metrics

Important

Adds /internal/evaluations/statistics endpoint to fetch evaluation statistics with mean and confidence intervals for specified runs and metrics, updating server and client-side code accordingly.

  • Behavior:
    • Adds /internal/evaluations/statistics endpoint in internal.rs to return aggregated statistics (mean, confidence intervals) for specified evaluation runs and metrics.
    • Implements get_evaluation_statistics_handler in get_statistics.rs to handle requests to the new endpoint.
    • Updates TensorZeroClient in tensorzero.ts to include getEvaluationStatistics() method for fetching statistics.
  • Data Processing:
    • Adds get_evaluation_statistics method to EvaluationQueries trait in evaluation_queries.rs.
    • Implements ClickHouse query logic in evaluation_queries.rs to fetch raw statistics and compute confidence intervals.
    • Defines EvaluationStatisticsRow struct in evaluation_queries.rs for deserializing statistics data.
  • TypeScript Bindings:
    • Adds EvaluationStatistics and GetEvaluationStatisticsResponse types in EvaluationStatistics.ts and GetEvaluationStatisticsResponse.ts.
    • Exports new types in index.ts.
  • Testing:
    • Includes unit tests for get_evaluation_statistics in evaluation_queries.rs.
    • Adds E2E tests for the new endpoint in evaluations.rs and evaluation_queries.rs.

This description was created by Ellipsis for 9120b40. You can customize this summary. It will automatically update as commits are pushed.

@shuyangli shuyangli mentioned this pull request Dec 20, 2025
52 tasks
@shuyangli shuyangli force-pushed the sl/migrate-get-evaluation-statistics branch 2 times, most recently from d670291 to d38afe3 Compare December 20, 2025 03:46
@shuyangli shuyangli force-pushed the sl/migrate-get-evaluation-statistics branch from d38afe3 to 9120b40 Compare December 20, 2025 04:00
Copy link
Member Author

/merge-queue

@shuyangli shuyangli marked this pull request as ready for review December 20, 2025 04:02
@shuyangli shuyangli requested a review from virajmehta December 20, 2025 04:02
@github-actions
Copy link
Contributor

πŸš€ Merge queue workflow triggered!

View the run: https://github.com/tensorzero/tensorzero/actions/runs/20388859467

@shuyangli shuyangli added this pull request to the merge queue Dec 20, 2025
Merged via the queue into main with commit d61d2b3 Dec 21, 2025
62 checks passed
@shuyangli shuyangli deleted the sl/migrate-get-evaluation-statistics branch December 21, 2025 00:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants