Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Jun 6, 2024

• add client-only mode to mii benchmark (#900)

  Show description for 75df1d7
  

  delock

  and

  lekurile

  authored
  75df1d7

  Copy full SHA for 75df1d7

Commits on May 1, 2024

• fix bug with queue.empty not being reliable (#898)

  Show description for cce6223
  mrwyattii

  authored
  cce6223

  Copy full SHA for cce6223

Commits on Apr 30, 2024

• Update tokens_per_sec calculation to work w/ stream and non-stream cases (#897)

  Show description for fdb8ee2
  lekurile

  authored
  fdb8ee2

  Copy full SHA for fdb8ee2

Commits on Apr 29, 2024

• updating tokens per second to include the token count of generated tokens. (#895)

  Show description for 1be0fc7
  

  guptha23

  and

  Chandra Sekhar Gupta Aravapalli

  authored
  1be0fc7

  Copy full SHA for 1be0fc7

Commits on Apr 9, 2024

• Update throughput-latency plot script (#881)

  Show description for fab5d06
  lekurile

  authored
  fab5d06

  Copy full SHA for fab5d06

Commits on Mar 29, 2024

• Fix response check in call_aml function (#882)

  HeyangQin

  authored
  df7119e

  Copy full SHA for df7119e

Commits on Mar 27, 2024

• dynamic setting of requst num and formatting (#880)

  mrwyattii

  authored
  02fc578

  Copy full SHA for 02fc578

Commits on Mar 19, 2024

• change kwargs for AML call to match vllm kwargs (#876)

  mrwyattii

  authored
  279a8fe

  Copy full SHA for 279a8fe

• Improve robustness of infernece AML benchmark (#875)

  HeyangQin

  authored
  18200d5

  Copy full SHA for 18200d5

Commits on Mar 18, 2024

• Update README.md

  awan-10

  authored
  c3ffec2

  Copy full SHA for c3ffec2

Commits on Mar 14, 2024

• Fix AML benchmark E2E measurment (#874)

  Show description for b0a5533
  mrwyattii

  authored
  b0a5533

  Copy full SHA for b0a5533

Commits on Mar 8, 2024

• Xiaoxia/fp v1 (#871)

  Show description for f415ec8
  

  xiaoxiawu-microsoft

  and

  Ubuntu

  authored
  f415ec8

  Copy full SHA for f415ec8

Commits on Mar 6, 2024

• Update Inference Benchmarking Scripts - Support AML (#868)

  Show description for 6e9ada6
  lekurile

  authored
  6e9ada6

  Copy full SHA for 6e9ada6

• Remove AML key from args dict when saving results (#870)

  Show description for b7ec5c3
  lekurile

  authored
  b7ec5c3

  Copy full SHA for b7ec5c3

Commits on Mar 1, 2024

• catch AML error response, add aml script (#869)

  mrwyattii

  authored
  ffb8a4b

  Copy full SHA for ffb8a4b

Commits on Feb 29, 2024

• Extend FastGen benchmark to use AML endpoints (#865)

  Show description for 8182a8b
  

  mrwyattii

  and

  lekurile

  authored
  8182a8b

  Copy full SHA for 8182a8b

Commits on Jan 19, 2024

• Generalize MII benchmark for any model (#851)

  mrwyattii

  authored
  8216f5f

  Copy full SHA for 8216f5f

Commits on Dec 20, 2023

• Improve Comms Benchmark Timing (#833)

  Show description for 8e4cdd8
  Quentin-Anthony

  authored
  8e4cdd8

  Copy full SHA for 8e4cdd8

Commits on Nov 21, 2023

• update MII benchmark to reflect changes in output type (#812)

  mrwyattii

  authored
  b116838

  Copy full SHA for b116838

Commits on Nov 17, 2023

• Adds script as an example of a run of DS-FastGen (#810)

  Show description for 09af71a
  

  PareesaMS

  and

  awan-10

  authored
  09af71a

  Copy full SHA for 09af71a

Commits on Nov 8, 2023

• Add benchmark scripts for DeepSpeed-FastGen (#805)

  Show description for 089baad
  tohtana

  authored
  089baad

  Copy full SHA for 089baad

Commits on Jun 23, 2023

• adds triton-bert-benchmarking script (#440)

  Show description for 1bfda32
  

  stephen-youn

  and

  styoun

  authored
  1bfda32

  Copy full SHA for 1bfda32

Commits on Apr 11, 2023

• fix HF infer & update mpsize arg (#262)

  Show description for 85a69e8
  

  satpalsr

  and

  mrwyattii

  authored
  85a69e8

  Copy full SHA for 85a69e8

Commits on Apr 3, 2023

• Add benchmarks (#254)

  Show description for 2007b52
  

  3 peopleauthored
  2007b52

  Copy full SHA for 2007b52

Commits on Mar 31, 2023

• DeepSpeedExamples major restructure (#245)

  awan-10

  authored
  127c7a1

  Copy full SHA for 127c7a1

Loading