Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Conversation

@shuyangli
Copy link
Member

@shuyangli shuyangli commented Dec 11, 2025

Important

Migrate model latency and usage data handling to tensorzero-core, adding new endpoints and updating client usage.

  • Endpoints:
    • Add get_model_usage_handler and get_model_latency_handler in tensorzero-core/src/endpoints/internal/models/mod.rs.
    • Add routes for /internal/models/usage and /internal/models/latency in gateway/src/routes/internal.rs.
  • Types:
    • Add GetModelUsageQueryParams and GetModelLatencyQueryParams in tensorzero-core/src/endpoints/internal/models/types.rs.
    • Add GetModelUsageResponse and GetModelLatencyResponse in internal/tensorzero-node/lib/bindings.
  • Client:
    • Update TensorZeroClient in ui/app/utils/tensorzero/tensorzero.ts to use new endpoints for model usage and latency.
    • Remove getModelUsageTimeseries and getModelLatencyQuantiles from internal/tensorzero-node/lib/index.ts.
  • Tests:
    • Add E2E tests for new endpoints in tensorzero-core/tests/e2e/endpoints/internal/models.rs.

This description was created by Ellipsis for 7f682ed. You can customize this summary. It will automatically update as commits are pushed.

@shuyangli shuyangli mentioned this pull request Dec 11, 2025
52 tasks
@shuyangli shuyangli force-pushed the sl/migrate-model-stats branch from 7a0cdc1 to b0a1087 Compare December 11, 2025 05:00
@shuyangli shuyangli force-pushed the sl/migrate-count-model branch from 16a3610 to b51c9b4 Compare December 11, 2025 05:05
@shuyangli shuyangli force-pushed the sl/migrate-model-stats branch from b0a1087 to 441086f Compare December 11, 2025 05:09
@shuyangli shuyangli marked this pull request as ready for review December 11, 2025 18:16
@shuyangli shuyangli force-pushed the sl/migrate-model-stats branch from 441086f to 4a9df53 Compare December 11, 2025 19:06
Base automatically changed from sl/migrate-count-model to main December 11, 2025 19:25
@shuyangli shuyangli changed the title [Stacked] Migrate getModelLatencyQuantiles and getModelUsageTimeseries Migrate getModelLatencyQuantiles and getModelUsageTimeseries Dec 11, 2025
@shuyangli shuyangli force-pushed the sl/migrate-model-stats branch from 4a9df53 to 00a4b59 Compare December 11, 2025 21:22
@graphite-app
Copy link

graphite-app bot commented Dec 11, 2025

Merge activity

  • Dec 11, 10:51 PM UTC: This pull request can not be added to the Graphite merge queue. Please try rebasing and resubmitting to merge when ready.
  • Dec 11, 10:51 PM UTC: Graphite disabled "merge when ready" on this PR due to: a merge conflict with the target branch; resolve the conflict and try again..

@shuyangli shuyangli force-pushed the sl/migrate-model-stats branch from 00a4b59 to 7f682ed Compare December 12, 2025 14:24
@shuyangli shuyangli requested review from virajmehta and removed request for GabrielBianconi December 12, 2025 14:27
@virajmehta virajmehta added this pull request to the merge queue Dec 12, 2025
@virajmehta virajmehta assigned shuyangli and unassigned virajmehta Dec 12, 2025
Merged via the queue into main with commit a6d6e73 Dec 12, 2025
55 checks passed
@virajmehta virajmehta deleted the sl/migrate-model-stats branch December 12, 2025 16:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants