-
Notifications
You must be signed in to change notification settings - Fork 763
Closed
4 / 44 of 4 issues completedLabels
clickhouseThis issue involves ClickHouseThis issue involves ClickHousepriority-highThe team is prioritizing this issue and will tackle it very soon.The team is prioritizing this issue and will tackle it very soon.rustThis issue involves Rust.This issue involves Rust.typescriptThis issue involves Typescript.This issue involves Typescript.
Description
TensorZero UI should only require a gateway URL, and API key, (and for the time being a Postgres URL). We should get rid of all other requirements.
NAPI database client code:
- getModelUsageTimeseries (Migrate getModelLatencyQuantiles and getModelUsageTimeseries #5124)
- getModelLatencyQuantiles (Migrate getModelLatencyQuantiles and getModelUsageTimeseries #5124)
- countDistinctModelsUsed (Migrate model count route to gateway #5123)
- queryEpisodeTable (Migrate queryEpisodeTable and queryEpisodeTableBounds to gateway #5131)
- queryEpisodeTableBounds (Migrate queryEpisodeTable and queryEpisodeTableBounds to gateway #5131)
- queryFeedbackByTargetId (Migrate queryFeedbackByTargetId #5227)
- queryDemonstrationFeedbackByInferenceId (Port queryDemonstrationFeedbackByInferenceId to backend #5340)
- queryFeedbackBoundsByTargetId (Migrate queryFeedbackBoundsByTargetId #5231)
- getCumulativeFeedbackTimeseries (Migrate getCumulativeFeedbackTimeseries #5269)
- countFeedbackByTargetId (Migrate countFeedbackByTargetId #5262)
- countRowsForDataset (Delete dataset builder napi calls #5251)
- insertRowsForDataset (Delete dataset builder napi calls #5251)
- countDatasets (Delete dataset builder napi calls #5251)
- countDatapointsForDatasetFunction (Port count datapoints query to gateway #5115)
- getFeedbackByVariant (unused, deleting in Migrate getCumulativeFeedbackTimeseries #5269)
Typescript code:
inference.server.ts
- Migrate
countInferencesForEpisodeto gateway (Migrate countInferencesForEpisode #5132) - Migrate
queryInferenceByIdto gateway (Use get inference v1 API in UI #5072) - Migrate
queryModelInferencesByInferenceIdto gateway (Add internal API to get ModelInference by inference ID #5107) - Migrate
countInferencesByFunctionto gateway (Port countInferencesByFunction to backend API #5372)
evaluations.server.ts
- Migrate
countTotalEvaluationRunsto gateway (Port countTotalEvaluationRuns to gateway #5120) - Migrate
getEvaluationRunInfoto gateway (Migrate list evaluation runs to gateway #5130) - Migrate
getEvaluationRunInfosto gateway (Migrate getEvaluationRunInfos to backend #5254) - Migrate
getEvaluationRunInfosForDatapointto gateway (Migrate getEvaluationRunInfosForDatapoint to backend #5258) - Migrate
getEvaluationResultsto gateway (Migrate getEvaluationsForDatapoint and getEvaluationResults #5273) - Migrate
getEvaluationStatisticsto gateway (Migrate getEvaluationStatistics #5346) - Migrate
countDatapointsForEvaluationto gateway (Migrate countDatapointsForEvaluation #5135) - Migrate
searchEvaluationRunsto gateway (Migrate searchEvaluationRuns #5136) - Migrate
getEvaluationsForDatapointto gateway (Migrate getEvaluationsForDatapoint #5371)
workflow_evaluations.server.ts
- Migrate
getWorkflowEvaluationRunsto gateway (Migrate workflow evaluation runs queries #5252) - Migrate
searchWorkflowEvaluationRunsto gateway (Migrate workflow evaluation runs queries #5252) - Migrate
countWorkflowEvaluationRunsto gateway (Migrate workflow evaluation runs queries #5252) - Migrate
getWorkflowEvaluationRunsByIdsto gateway (Migrate getWorkflowEvaluationRunsByIds #5264) - Migrate
getWorkflowEvaluationRunEpisodesByRunIdWithFeedbackto gateway (Migrate remaining workflow eval APIs #5280) - Migrate
getWorkflowEvaluationRunStatisticsByMetricNameto gateway (Migrate getWorkflowEvaluationRunStatisticsByMetricName #5272) - Migrate
countWorkflowEvaluationRunEpisodesto gateway (Migrate remaining workflow eval APIs #5280) - Migrate
getWorkflowEvaluationProjectsto gateway (Migrate getWorkflowEvaluationProjects #5173) - Migrate
countWorkflowEvaluationProjectsto gateway (Migrate countWorkflowEvaluationProjects #5232) - Migrate
getWorkflowEvaluationRunEpisodesByTaskNameto gateway (Migrate get/countWorkflowEvaluationRunEpisodesByTaskName #5287) - Migrate
countWorkflowEvaluationRunEpisodesByTaskNameto gateway (Migrate get/countWorkflowEvaluationRunEpisodesByTaskName #5287)
function.ts
- Migrate
getVariantPerformancesto gateway (Migrate getVariantPerformances #5278) - Migrate
countMetricDatato gateway - Migrate
countDemonstrationDataForFunctionto gateway (Port "curated inference" clickhouse queries to gateway #5067) - Migrate
getVariantCountsto gateway (Port count inferences by variant to gateway #5106) - Remove
getUsedVariantsto just usegetVariantCounts - Migrate
getFunctionThroughputByVariantto gateway (Migrate getFunctionThroughputByVariant #5243)
feedback.ts
- Migrate
queryMetricsWithFeedbackto gateway (Migrate queryMetricsWithFeedback (to get_function_metrics) #5141) - Migrate
queryLatestFeedbackIdByMetricto gateway (Migrate queryLatestFeedbackIdByMetric to gateway #5145)
curation.server.ts
- Migrate
countFeedbacksForMetricto gateway (Port "curated inference" clickhouse queries to gateway #5067) - Migrate
countCuratedInferencesto gateway (Port "curated inference" clickhouse queries to gateway #5067)
Cleanup
- Rename some of the
-statsendpoints to becount(sincestatsmay be confused with actual aggregating statistics) (Rename -stats to -count for internal routes for clarity #5353) - Reorder modules so it's all
endpoints::module::internal::... - Do another pass to make all underscore routes to be hyphenated (Replace hyphen with understores in API routes #5382)
Sub-issues
Metadata
Metadata
Assignees
Labels
clickhouseThis issue involves ClickHouseThis issue involves ClickHousepriority-highThe team is prioritizing this issue and will tackle it very soon.The team is prioritizing this issue and will tackle it very soon.rustThis issue involves Rust.This issue involves Rust.typescriptThis issue involves Typescript.This issue involves Typescript.