Thanks to visit codestin.com
Credit goes to github.com

Skip to content
This repository was archived by the owner on Jun 3, 2025. It is now read-only.

Add LLMPerf example for DeepSparse LLM Server#1502

Merged
mgoin merged 6 commits into
mainfrom
llmperf-example
Jan 8, 2024
Merged

Add LLMPerf example for DeepSparse LLM Server#1502
mgoin merged 6 commits into
mainfrom
llmperf-example

Conversation

@mgoin

@mgoin mgoin commented Dec 28, 2023

Copy link
Copy Markdown
Member

Simple example walking through how to run LLMPerf benchmarks and how to analyze the output statistics

inter_token_vs_throughput

@mgoin mgoin merged commit c9b859d into main Jan 8, 2024
@mgoin mgoin deleted the llmperf-example branch January 8, 2024 19:05
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants