Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Feb 27, 2026

• [Stateful] Implement length-aware keying to minimize padding in BatchElements (Part 2/3) (#37565)

  Show description for 30518c8
  Eliaaazzz

  authored
  30518c8

  Copy full SHA for 30518c8

Commits on Feb 12, 2026

• Add OOM handling for RunInference with model manager (#37557)

  Show description for 22d1c57
  AMOOOMA

  authored
  22d1c57

  Copy full SHA for 22d1c57

Commits on Feb 9, 2026

• Update RunInference to work with model manager (#37506)

  Show description for 6602f1e
  

  AMOOOMA

  and

  damccorm

  authored
  6602f1e

  Copy full SHA for 6602f1e

Commits on Jan 30, 2026

• [RunInference] Add content-aware dynamic batching via element_size_fn… (#37428)

  Show description for cdf4814
  Eliaaazzz

  authored
  cdf4814

  Copy full SHA for cdf4814

Commits on Jan 13, 2026

• Catch breaking import error (#37295)

  Show description for 752da38
  tarun-google

  authored
  752da38

  Copy full SHA for 752da38

Commits on Jan 12, 2026

• update RateLimiter execution function name (#37287)

  tarun-google

  authored
  d022338

  Copy full SHA for d022338

Commits on Jan 9, 2026

• Support for RateLimiter in Beam Remote Model Handler (#37218)

  Show description for 815041e
  tarun-google

  authored
  815041e

  Copy full SHA for 815041e

Commits on Dec 15, 2025

• Allow inference args to be passed in for most cases (#37094)

  Show description for 722dc6d
  damccorm

  authored
  722dc6d

  Copy full SHA for 722dc6d

Commits on Sep 2, 2025

• Introduce more abstract handling of throttling signaling (#35984)

  Show description for 35969b3
  

  jrmccluskey

  and

  damccorm

  authored
  35969b3

  Copy full SHA for 35969b3

Commits on Apr 24, 2025

• Update RunInference type hints to PEP 585 standards (#34719)

  jrmccluskey

  authored
  e69a7ba

  Copy full SHA for e69a7ba

Commits on Apr 3, 2025

• Introduce RemoteModelHandler abstract base class (#34379)

  Show description for 81642eb
  jrmccluskey

  authored
  81642eb

  Copy full SHA for 81642eb

Commits on Mar 14, 2025

• Fix pre/postprocess type hints (#34298)

  damccorm

  authored
  d3b1312

  Copy full SHA for d3b1312

Commits on Aug 22, 2024

• Move RunInference GC to finalize_bundle (#32281)

  damccorm

  authored
  8488a0d

  Copy full SHA for 8488a0d

Commits on Aug 21, 2024

• Add timeout to runinference (#32237)

  Show description for b873be8
  damccorm

  authored
  b873be8

  Copy full SHA for b873be8

Commits on Aug 7, 2024

• Add warning + doc callout when encountering ri pickling errors (#32063)

  damccorm

  authored
  44a9942

  Copy full SHA for 44a9942

Commits on Jun 21, 2024

• Add support for sharing models across steps (#31665)

  Show description for 14fd366
  damccorm

  authored
  14fd366

  Copy full SHA for 14fd366

Commits on Apr 25, 2024

• Add ability to load multiple copies of a model across processes (#31052)

  Show description for 3c8a881
  damccorm

  authored
  3c8a881

  Copy full SHA for 3c8a881

Commits on Apr 16, 2024

• Add mechanism for skipping batching if your data is prebatched (#30961)

  Show description for ae597cc
  damccorm

  authored
  ae597cc

  Copy full SHA for ae597cc

Commits on Dec 12, 2023

• Update links to point to About Beam ML (#29709)

  Show description for 5e00fee
  rszper

  authored
  5e00fee

  Copy full SHA for 5e00fee

Commits on Nov 20, 2023

• Enable the useless-with-lock check (#29468)

  jrmccluskey

  authored
  9161250

  Copy full SHA for 9161250

Commits on Oct 30, 2023

• Don't assume env vars are set in model handler (#29200)

  Show description for 28f6e33
  damccorm

  authored
  28f6e33

  Copy full SHA for 28f6e33

Commits on Oct 13, 2023

• Fix `watch_file_pattern` condition in RunInference (#28948)

  Show description for dad13cf
  AnandInguva

  authored
  dad13cf

  Copy full SHA for dad13cf

Commits on Oct 12, 2023

• Add docs for per key inference (#28243)

  Show description for 835bd65
  

  damccorm

  and

  rszper

  authored
  835bd65

  Copy full SHA for 835bd65

Commits on Aug 31, 2023

• Add support for limiting number of models in memory (#28263)

  Show description for a472d1a
  damccorm

  authored
  a472d1a

  Copy full SHA for a472d1a

• Keep track of metrics at the KeyedModelHandler level (#28228)

  Show description for 205083d
  damccorm

  authored
  205083d

  Copy full SHA for 205083d

• Add some simple annotations to Python transforms. (#28191)

  robertwb

  authored
  f91bb68

  Copy full SHA for f91bb68

Commits on Aug 30, 2023

• Update KeyMhMapping to KeyModelMapping (#28209)

  damccorm

  authored
  00136b1

  Copy full SHA for 00136b1

Commits on Aug 29, 2023

• Per key model updates (#28161)

  Show description for 3b95d14
  

  damccorm

  and

  AnandInguva

  authored
  3b95d14

  Copy full SHA for 3b95d14

Commits on Aug 28, 2023

• Shell out to model handlers to collect byte sizes (#28182)

  Show description for 252c713
  damccorm

  authored
  252c713

  Copy full SHA for 252c713

Commits on Aug 24, 2023

• Always proxy RunInference with large models (#27989)

  Show description for 6ca4110
  

  damccorm

  and

  riteshghorse

  authored
  6ca4110

  Copy full SHA for 6ca4110

Commits on Aug 23, 2023

• Fix error condition checking (#28076)

  damccorm

  authored
  99dfcef

  Copy full SHA for 99dfcef

Commits on Aug 11, 2023

• Add ability to run per key inference (#27857)

  Show description for a5f1347
  damccorm

  authored
  a5f1347

  Copy full SHA for a5f1347

Commits on Aug 3, 2023

• Add model manager class to hold many models at once (#27603)

  Show description for a0d73b8
  damccorm

  authored
  a0d73b8

  Copy full SHA for a0d73b8

Commits on May 15, 2023

• Allow model handlers to request multi_process_shared model (#26688)

  Show description for 6a99cfe
  damccorm

  authored
  6a99cfe

  Copy full SHA for 6a99cfe

Commits on May 13, 2023

• More tests and docs update for env_vars in ModelHandler (#26603)

  Show description for 6fedef1
  kerrydc

  authored
  6fedef1

  Copy full SHA for 6fedef1