This repository was archived by the owner on Jul 4, 2025. It is now read-only.
This repository was archived by the owner on Jul 4, 2025. It is now read-only.
feat: TensorRT-LLM better error logs for Cuda/Nvidia driver out of date #1019
Description
Problem
- Have an outdated cuda toolkit and nvidia driver
- Get error message:
× CUDA version 12.3 is not compatible with TensorRT-LLM models. Required version: 12.4
3.Install latest cuda toolkit
4. Get the same message
5. Realize also need to install Nvidia Driver (is that where we're checking cuda version?)
6. Issue resolved.
Success Criteria
Low hanging fruit is to just give a better error message:
Your Nvidia Driver and Cuda Toolkit is not compatible with the latest TRT-LLM Models.
Please download the latest:
NVIDIA driver version ___ or higher.
CUDA Toolkit version ___ or higher.
Additional context
Add any other context or screenshots about the feature request here.