Thanks to visit codestin.com
Credit goes to github.com

Skip to content

A user pauses an active run #798

@sjawhar

Description

@sjawhar

A couple use cases:

  • On k8s, killing a run leads to the pod/container being destroyed. It can't be "un-killed" later. Sometimes one might want to pause a bunch of runs, e.g. started a big batch of runs, started hitting LLM API rate limits, now want to pause most of them to let some important ones finish, and changing batch concurrency has no effect because the runs are already started.
    • this would also mean that pods/nodes stay active and doing nothing, potentially costing us a lot of money
  • This could also be used as a mechanism for multi-agent interaction within a task, e.g. by starting multiple branches within the same task and then inserting/removing pauses in e.g. round-robin

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions