[Feature]: Allow `dstack offer` to aggregate GPU information #2992

peterschmidt85 · 2025-08-15T21:46:49Z

As a part of #2142

Added api/project/<project name>/gpus/list that accepts a run_spec (similar to api/project/<project name>/runs/get_plan used in dstack offer) + group_by. The group_by property is a list accepting backend, region, and count. This API will be used by both CLI (dstack list gpu) UI (the Offers page)
Added --group-by to dstack offer provide aggregated information.

… and backends #2142 (WIP)

… and backends #2142 (WIP) Fix linter

… and backends #2142 (WIP) Added grouping by count

… and backends #2142 (WIP) Made price per GPU

… and backends #2142 (WIP) Removed outdated comment

src/dstack/_internal/server/services/runs.py

src/dstack/_internal/server/routers/runs.py

src/dstack/_internal/cli/commands/list.py

src/dstack/_internal/server/services/runs.py

… and backends #2142 (WIP) Added tests

… and backends #2142 (WIP) Fixed linter

… and backends #2142 (WIP) Renamed `dstack list gpu` to `dstack gpu`

… and backends #2142 (WIP) Moved the /gpus API to a separate routing; also moved GPU-related logic from runs.

… and backends #2142 (WIP) Minor refactoring

… and backends #2142 Fixed group_by bug; also added validation (disallow grouping by region without backend)

… and backends #2142 Show an error if unknown arg is passed to `dstack gpu`

… and backends #2142 Reverted unneeded change

src/dstack/_internal/cli/commands/gpu.py

r4victor · 2025-08-19T06:12:28Z

src/tests/_internal/server/routers/test_gpus.py

+
+    @pytest.mark.asyncio
+    @pytest.mark.parametrize("test_db", ["sqlite", "postgres"], indirect=True)
+    async def test_exact_aggregation_values(


Not sure how maintainable this test is but ok

… and backends #2142 Merged `dstack gpu` to `dstack offer`

… and backends #2142 Removed `dstack gpu`

… and backends #2142 Documented `--group-by` Plus, a minor fix;

[Feature]: Allow listing available key resources such as gpu, region,…

0ff98ef

… and backends #2142 (WIP)

peterschmidt85 linked an issue Aug 15, 2025 that may be closed by this pull request

[Feature]: Allow listing available key resources such as gpu, region, and backends #2142

Closed

peterschmidt85 added 3 commits August 15, 2025 23:48

[Feature]: Allow listing available key resources such as gpu, region,…

dbb9c1a

… and backends #2142 (WIP) Fix linter

[Feature]: Allow listing available key resources such as gpu, region,…

41f4edb

… and backends #2142 (WIP) Added grouping by count

[Feature]: Allow listing available key resources such as gpu, region,…

6713271

… and backends #2142 (WIP) Made price per GPU

peterschmidt85 changed the title ~~[Feature]: Allow listing available key resources such as gpu, region, and backends~~ [Feature]: Add dstack list gpu that aggregates offers information Aug 16, 2025

peterschmidt85 requested a review from r4victor August 18, 2025 07:31

peterschmidt85 marked this pull request as ready for review August 18, 2025 07:31

[Feature]: Allow listing available key resources such as gpu, region,…

e04c290

… and backends #2142 (WIP) Removed outdated comment

This comment was marked as resolved.

Sign in to view

r4victor reviewed Aug 18, 2025

View reviewed changes

src/dstack/_internal/server/services/runs.py Show resolved Hide resolved

r4victor reviewed Aug 18, 2025

View reviewed changes

src/dstack/_internal/server/routers/runs.py Outdated Show resolved Hide resolved

r4victor reviewed Aug 18, 2025

View reviewed changes

src/dstack/_internal/cli/commands/list.py Outdated Show resolved Hide resolved

r4victor reviewed Aug 18, 2025

View reviewed changes

src/dstack/_internal/server/services/runs.py Outdated Show resolved Hide resolved

This comment was marked as resolved.

Sign in to view

peterschmidt85 added 4 commits August 18, 2025 12:44

[Feature]: Allow listing available key resources such as gpu, region,…

ed80c2e

… and backends #2142 (WIP) Added tests

[Feature]: Allow listing available key resources such as gpu, region,…

0a757c9

… and backends #2142 (WIP) Fixed linter

[Feature]: Allow listing available key resources such as gpu, region,…

5cf1052

… and backends #2142 (WIP) Renamed `dstack list gpu` to `dstack gpu`

[Feature]: Allow listing available key resources such as gpu, region,…

c8d7bdd

… and backends #2142 (WIP) Moved the /gpus API to a separate routing; also moved GPU-related logic from runs.

peterschmidt85 changed the title ~~[Feature]: Add dstack list gpu that aggregates offers information~~ [Feature]: Add dstack gpu that aggregates offers information Aug 18, 2025

peterschmidt85 added 4 commits August 18, 2025 14:21

[Feature]: Allow listing available key resources such as gpu, region,…

5725924

… and backends #2142 (WIP) Minor refactoring

[Feature]: Allow listing available key resources such as gpu, region,…

f9744d4

… and backends #2142 Fixed group_by bug; also added validation (disallow grouping by region without backend)

[Feature]: Allow listing available key resources such as gpu, region,…

c8d6b3d

… and backends #2142 Show an error if unknown arg is passed to `dstack gpu`

[Feature]: Allow listing available key resources such as gpu, region,…

fdf6da6

… and backends #2142 Reverted unneeded change

r4victor reviewed Aug 19, 2025

View reviewed changes

src/dstack/_internal/cli/commands/gpu.py Outdated Show resolved Hide resolved

r4victor reviewed Aug 19, 2025

View reviewed changes

src/dstack/_internal/cli/commands/gpu.py Outdated Show resolved Hide resolved

r4victor approved these changes Aug 19, 2025

View reviewed changes

r4victor reviewed Aug 19, 2025

View reviewed changes

[Feature]: Allow listing available key resources such as gpu, region,…

305a362

… and backends #2142 Merged `dstack gpu` to `dstack offer`

peterschmidt85 changed the title ~~[Feature]: Add dstack gpu that aggregates offers information~~ [Feature]: Allow dstack offer to aggregate GPU information Aug 19, 2025

peterschmidt85 added 2 commits August 19, 2025 14:21

[Feature]: Allow listing available key resources such as gpu, region,…

565e54d

… and backends #2142 Removed `dstack gpu`

[Feature]: Allow listing available key resources such as gpu, region,…

83b1523

… and backends #2142 Documented `--group-by` Plus, a minor fix;

peterschmidt85 merged commit 0d0e654 into master Aug 20, 2025
26 checks passed

peterschmidt85 deleted the 2142-dstack-list branch August 20, 2025 08:16

r4victor mentioned this pull request Sep 5, 2025

Add a script to automatically generate expanded release notes using an LLM #3080

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Feature]: Allow `dstack offer` to aggregate GPU information #2992

[Feature]: Allow `dstack offer` to aggregate GPU information #2992

Uh oh!

peterschmidt85 commented Aug 15, 2025 •

edited

Loading

Uh oh!

This comment was marked as resolved.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

Uh oh!

Uh oh!

r4victor Aug 19, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

[Feature]: Allow dstack offer to aggregate GPU information #2992

[Feature]: Allow dstack offer to aggregate GPU information #2992

Uh oh!

Conversation

peterschmidt85 commented Aug 15, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

This comment was marked as resolved.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

Uh oh!

Uh oh!

r4victor Aug 19, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

[Feature]: Allow `dstack offer` to aggregate GPU information #2992

[Feature]: Allow `dstack offer` to aggregate GPU information #2992

peterschmidt85 commented Aug 15, 2025 •

edited

Loading