Codestin Search App

ssncferreira · 2026-08-17T09:51:30Z

Description

Prices in ai_model_prices come from two places: the price book embedded in each Coder release, and prices set through the experimental CLI (#27926). Until now, they were indistinguishable, so the startup seeder re-applied the book over every row, and a price someone set would silently revert on the next restart.

This adds a source column with values default and custom, and keeps a row for each. Readers resolve a model to its custom price when one exists and fall back to the book, including the cost path that prices an interception.

Keeping both rows means the price book stays current underneath an override, so a future delete can restore it.

Note: the endpoint still only accepts models the price book does not cover. Overriding a price the book already carries is handled by the follow-up issue https://linear.app/codercom/issue/AIGOV-594.

Changes

Add a migration for the ai_model_price_source enum and a source column, backfilled to default and then NOT NULL. source joins the primary key, so a model can hold one row per source.
Take a source parameter on UpsertAIModelPrices. Each source keeps its own row, so the price book and a custom price never overwrite each other.
Resolve to the custom price in GetAIModelPriceByProviderModel and GetAIModelPrices, so both the interception cost snapshot and the list endpoint use it.
Seed the price book as default, and write prices set through the endpoint as custom.

Closes https://linear.app/codercom/issue/AIGOV-592

Note

Initially generated by Claude Opus 5, modified and reviewed by @ssncferreira

ssncferreira · 2026-08-17T09:51:44Z

This stack of pull requests is managed by Graphite. Learn more about stacking.

linear-code · 2026-08-19T16:24:55Z

AIGOV-592

johnstcn · 2026-08-19T16:34:25Z

+WHERE CASE
+		-- A custom price claims any row, including one the price book wrote.
+		WHEN @source::ai_model_price_source = 'custom' THEN true
+		-- The price book leaves custom rows alone.
+		ELSE ai_model_prices.source <> 'custom'
+	END
+	AND (
+		ai_model_prices.input_price,
+		ai_model_prices.output_price,
+		ai_model_prices.cache_read_price,
+		ai_model_prices.cache_write_price,
+		ai_model_prices.source
+	) IS DISTINCT FROM (
+		EXCLUDED.input_price,
+		EXCLUDED.output_price,
+		EXCLUDED.cache_read_price,
+		EXCLUDED.cache_write_price,
+		EXCLUDED.source
+	);


We could alternatively keep both rows with the custom and default source and then join / filter when querying? This would allow an administrator to delete their custom price and revert to the default from the price book.

This is actually a great idea! 🏆 This way we won't lose the default price book! We just need to guarantee that the read queries resolve the model row: if custom is present return it, otherwise fallback to default, which will be used by the CLI/API as well as when calculating the interception cost. Will make these changes 👍

We currently don't have a way of deleting custom prices, but we can add a delete command to the CLI, for instance 🤔

We don't need to add the delete command now. For the sorting, you can do something like ORDER BY CASE WHEN ... THEN 1 ELSE 0

I think I prefer to do it now because this changes the logic for the new column source which will also need to be considered as part of the PK for ai_model_prices. Should be easy to do 👍

Addressed in 4af28ec

ssncferreira · 2026-08-20T10:36:40Z

Merge activity

Aug 20, 10:36 AM UTC: A user started a stack merge that includes this pull request via Graphite.
Aug 20, 10:36 AM UTC: @ssncferreira merged this pull request with Graphite.

@ssncferreira

## Description The experimental CLI could only price models the price book does not cover, so an operator with a negotiated rate for a model Coder already prices had no way to record it. The restriction existed because a single row served both the price book and prices set through the API, and the startup seeder would overwrite an override on the next restart. Each source now keeps its own row (#28204), so that no longer applies. This removes the restriction: a price set through the CLI takes effect over the price book for any model, and the book stays underneath it. ## Changes - Remove the validation that rejected models the price book covers. - Delete `prices.IsDefaultPriced` and the index behind it, which existed only for that check. - Generalize the `coder exp ai-model-prices update` help. - Document that a custom price overrides the price book and does not follow its updates. - Rework the spend approximation callout around what a custom price can and cannot correct. Closes https://linear.app/codercom/issue/AIGOV-594 > [!NOTE] > Initially generated by Claude Opus 5, modified and reviewed by @ssncferreira

@ssncferreira

## Description Prices in `ai_model_prices` come from two places: the price book embedded in each Coder release, and prices set through the experimental CLI (#27926). Until now, they were indistinguishable, so the startup seeder re-applied the book over every row, and a price someone set would silently revert on the next restart. This adds a `source` column with values `default` and `custom`, and keeps a row for each. Readers resolve a model to its custom price when one exists and fall back to the book, including the cost path that prices an interception. Keeping both rows means the price book stays current underneath an override, so a future delete can restore it. Note: the endpoint still only accepts models the price book does not cover. Overriding a price the book already carries is handled by the follow-up issue https://linear.app/codercom/issue/AIGOV-594. ## Changes - Add a migration for the `ai_model_price_source` enum and a `source` column, backfilled to `default` and then `NOT NULL`. `source` joins the primary key, so a model can hold one row per source. - Take a `source` parameter on `UpsertAIModelPrices`. Each source keeps its own row, so the price book and a custom price never overwrite each other. - Resolve to the custom price in `GetAIModelPriceByProviderModel` and `GetAIModelPrices`, so both the interception cost snapshot and the list endpoint use it. - Seed the price book as `default`, and write prices set through the endpoint as `custom`. Closes https://linear.app/codercom/issue/AIGOV-592 > [!NOTE] > Initially generated by Claude Opus 5, modified and reviewed by @ssncferreira

@ssncferreira

## Description The experimental CLI could only price models the price book does not cover, so an operator with a negotiated rate for a model Coder already prices had no way to record it. The restriction existed because a single row served both the price book and prices set through the API, and the startup seeder would overwrite an override on the next restart. Each source now keeps its own row (#28204), so that no longer applies. This removes the restriction: a price set through the CLI takes effect over the price book for any model, and the book stays underneath it. ## Changes - Remove the validation that rejected models the price book covers. - Delete `prices.IsDefaultPriced` and the index behind it, which existed only for that check. - Generalize the `coder exp ai-model-prices update` help. - Document that a custom price overrides the price book and does not follow its updates. - Rework the spend approximation callout around what a custom price can and cannot correct. Closes https://linear.app/codercom/issue/AIGOV-594 > [!NOTE] > Initially generated by Claude Opus 5, modified and reviewed by @ssncferreira

github-actions Bot assigned ssncferreira Aug 17, 2026

ssncferreira force-pushed the ssncf/ai-model-price-source branch 5 times, most recently from beab408 to c2143fa Compare August 19, 2026 16:23

ssncferreira force-pushed the ssncf/ai-model-price-source branch from c2143fa to 29a2d26 Compare August 19, 2026 16:31

ssncferreira marked this pull request as ready for review August 19, 2026 16:31

ssncferreira requested review from ibetitsmike and johnstcn as code owners August 19, 2026 16:31

ssncferreira requested a review from evgeniy-scherbina August 19, 2026 16:32

johnstcn reviewed Aug 19, 2026

View reviewed changes

ssncferreira marked this pull request as draft August 19, 2026 17:20

ibetitsmike approved these changes Aug 19, 2026

View reviewed changes

ssncferreira force-pushed the ssncf/ai-model-price-source branch from e6affe7 to 4af28ec Compare August 19, 2026 19:20

ssncferreira changed the title ~~feat: add source column to ai_model_prices~~ feat: distinguish default and custom AI model prices Aug 19, 2026

ssncferreira marked this pull request as ready for review August 19, 2026 19:46

ssncferreira requested a review from johnstcn August 19, 2026 19:46

johnstcn approved these changes Aug 19, 2026

View reviewed changes

Comment thread coderd/database/queries/aicostcontrol.sql Outdated

This was referenced Aug 19, 2026

feat: support custom prices for models in the price book #28328

Merged

feat: add a source filter to the AI model price list #28329

Merged

ssncferreira force-pushed the ssncf/ai-model-price-source branch from 4217edb to 350bc71 Compare August 20, 2026 08:11

ssncferreira added 6 commits August 20, 2026 10:10

feat: add source column to ai_model_prices

af6ad09

feat: keep one AI model price row per source

1c0e445

chore: fix migration numbers

17c8257

test: add TestRecordTokenUsageModelPriceResolution/CustomOnly

bbe9f35

chore: address comments

a246ba4

chore: fix migration numbers

8e53141

ssncferreira force-pushed the ssncf/ai-model-price-source branch from 350bc71 to 8e53141 Compare August 20, 2026 10:10

ssncferreira merged commit 9390e51 into main Aug 20, 2026
25 checks passed

ssncferreira deleted the ssncf/ai-model-price-source branch August 20, 2026 10:37

Navigation Menu

Uh oh!

feat: distinguish default and custom AI model prices - #28204

feat: distinguish default and custom AI model prices#28204
ssncferreira merged 6 commits into
mainfrom
ssncf/ai-model-price-source

ssncferreira commented Aug 17, 2026 •

edited

Loading

Uh oh!

ssncferreira commented Aug 17, 2026 •

edited

Loading

Uh oh!

linear-code Bot commented Aug 19, 2026

Uh oh!

johnstcn Aug 19, 2026

Uh oh!

ssncferreira Aug 19, 2026

Uh oh!

johnstcn Aug 19, 2026 •

edited

Loading

Uh oh!

ssncferreira Aug 19, 2026

Uh oh!

ssncferreira Aug 19, 2026

Uh oh!

Uh oh!

ssncferreira commented Aug 20, 2026 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

ssncferreira commented Aug 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Changes

Uh oh!

ssncferreira commented Aug 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

linear-code Bot commented Aug 19, 2026

Uh oh!

johnstcn Aug 19, 2026

Choose a reason for hiding this comment

Uh oh!

ssncferreira Aug 19, 2026

Choose a reason for hiding this comment

Uh oh!

johnstcn Aug 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

ssncferreira Aug 19, 2026

Choose a reason for hiding this comment

Uh oh!

ssncferreira Aug 19, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

ssncferreira commented Aug 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merge activity

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

ssncferreira commented Aug 17, 2026 •

edited

Loading

ssncferreira commented Aug 17, 2026 •

edited

Loading

johnstcn Aug 19, 2026 •

edited

Loading

ssncferreira commented Aug 20, 2026 •

edited

Loading