Thanks to visit codestin.com
Credit goes to github.com

Skip to content
This repository was archived by the owner on Jun 3, 2025. It is now read-only.

Add kvcache support to debug_analysis.py and engine.py#1132

Merged
mgoin merged 6 commits into
mainfrom
kvcache_debug_analysis
Jul 21, 2023
Merged

Add kvcache support to debug_analysis.py and engine.py#1132
mgoin merged 6 commits into
mainfrom
kvcache_debug_analysis

Conversation

@alexm-redhat

Copy link
Copy Markdown
Contributor

Adds the ability to run kvcache via the debug_analysis.py.

@SageMoore SageMoore left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This diff looks reasonable to me, Alex. I think once we resolve the formatting issues we should be good to merge.

Comment thread src/deepsparse/debug_analysis.py Outdated
@alexm-redhat alexm-redhat force-pushed the kvcache_debug_analysis branch from 48b20d5 to bb6ba69 Compare July 21, 2023 15:15
@alexm-redhat

Copy link
Copy Markdown
Contributor Author

Formatting issues are resolved (thanks to Michael)

Comment thread src/deepsparse/debug_analysis.py
Comment thread src/deepsparse/engine.py Outdated
Comment thread src/deepsparse/engine.py Outdated

@bnellnm bnellnm left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall looks good. Just a few minor comments

@bnellnm bnellnm left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I meant to hit "request changes" on my last round of comments. I couldn't figure out how to go back and change it.

Comment thread src/deepsparse/engine.py
Comment thread src/deepsparse/utils/onnx.py
bnellnm
bnellnm previously approved these changes Jul 21, 2023
Comment thread src/deepsparse/utils/onnx.py Outdated
@mgoin mgoin merged commit 0ae6aa7 into main Jul 21, 2023
@mgoin mgoin deleted the kvcache_debug_analysis branch July 21, 2023 22:58
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants