Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Conversation

@shuyangli
Copy link
Member

@shuyangli shuyangli commented Dec 18, 2025

  • Added a new /internal/functions/{function_name}/variant-performances endpoint that returns performance statistics (average, standard deviation, confidence intervals) for metrics across function variants

Important

Introduces a new endpoint to fetch variant performance statistics, with backend, API, and frontend changes, along with comprehensive testing.

  • Backend:
    • Added get_variant_performances to FeedbackQueries in feedback.rs.
    • Implemented build_variant_performance_query in feedback.rs for SQL query construction.
    • Added VariantPerformanceRow and GetVariantPerformanceParams structs in feedback.rs.
  • API:
    • New endpoint /internal/functions/{function_name}/variant-performances in internal.rs.
    • Handler get_variant_performances_handler in internal.rs.
  • Frontend:
    • Added getVariantPerformances method to TensorZeroClient in tensorzero.ts.
    • Updated VariantPerformance component to display performance data.
  • Tests:
    • Added unit tests for get_variant_performances in feedback_queries.rs.
    • Added E2E tests for the new endpoint in functions.rs.

This description was created by Ellipsis for 81c192e. You can customize this summary. It will automatically update as commits are pushed.

@shuyangli shuyangli force-pushed the sl/migrate-get-variant-performances branch 2 times, most recently from c46c31c to c35d416 Compare December 18, 2025 19:46
@shuyangli shuyangli mentioned this pull request Dec 18, 2025
52 tasks
@shuyangli shuyangli force-pushed the sl/migrate-get-function-throughput-by-variant branch from 341c0a8 to c329576 Compare December 18, 2025 21:55
@shuyangli shuyangli force-pushed the sl/migrate-get-function-throughput-by-variant branch 2 times, most recently from 32e9aee to e538951 Compare December 18, 2025 22:41
Base automatically changed from sl/migrate-get-function-throughput-by-variant to main December 19, 2025 01:03
@shuyangli shuyangli changed the title [Stacked] Migrate getVariantPerformances Migrate getVariantPerformances Dec 19, 2025
@shuyangli shuyangli force-pushed the sl/migrate-get-variant-performances branch from c35d416 to c158bd7 Compare December 19, 2025 19:39
@shuyangli shuyangli force-pushed the sl/migrate-get-variant-performances branch from c158bd7 to 748ac12 Compare December 19, 2025 22:06
@shuyangli shuyangli force-pushed the sl/migrate-get-variant-performances branch 3 times, most recently from 710723e to cda35e8 Compare December 19, 2025 22:46
Copy link
Member Author

/merge-queue

@shuyangli shuyangli marked this pull request as ready for review December 19, 2025 22:47
@github-actions
Copy link
Contributor

🚀 Merge queue workflow triggered!

View the run: https://github.com/tensorzero/tensorzero/actions/runs/20384536920

@shuyangli shuyangli force-pushed the sl/migrate-get-variant-performances branch from cda35e8 to 5c277d4 Compare December 19, 2025 23:07
@GabrielBianconi GabrielBianconi added this pull request to the merge queue Dec 19, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Dec 20, 2025
@shuyangli shuyangli added this pull request to the merge queue Dec 20, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Dec 20, 2025
@shuyangli shuyangli added this pull request to the merge queue Dec 20, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Dec 20, 2025
@shuyangli shuyangli enabled auto-merge December 20, 2025 04:04
@shuyangli
Copy link
Member Author

/merge-queue

@github-actions
Copy link
Contributor

🚀 Merge queue workflow triggered!

View the run: https://github.com/tensorzero/tensorzero/actions/runs/20400622269

Use a real variant for basic_test
@shuyangli shuyangli force-pushed the sl/migrate-get-variant-performances branch from 1bbbb51 to 81c192e Compare December 21, 2025 10:47
@shuyangli
Copy link
Member Author

Fixed merge conflicts

/merge-queue

@shuyangli
Copy link
Member Author

/merge-queue

@github-actions
Copy link
Contributor

🚀 Merge queue workflow triggered!

View the run: https://github.com/tensorzero/tensorzero/actions/runs/20409790503

@shuyangli shuyangli added this pull request to the merge queue Dec 22, 2025
github-merge-queue bot pushed a commit that referenced this pull request Dec 22, 2025
Use a real variant for basic_test
github-merge-queue bot pushed a commit that referenced this pull request Dec 22, 2025
Use a real variant for basic_test
Merged via the queue into main with commit 20fb410 Dec 22, 2025
64 checks passed
@shuyangli shuyangli deleted the sl/migrate-get-variant-performances branch December 22, 2025 19:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants