-
Notifications
You must be signed in to change notification settings - Fork 4
Open
Description
Hi authors,
Thanks for your releasing code! Recently I want to try your vllm version and I follow the instructions to install. But I failed to build vllm, the error is:
File "/home//anaconda3/envs/vllm_string/lib/python3.10/subprocess.py", line 369, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['cmake', '/home//STRING/vllm_string', '-G', 'Ninja', '-DCMAKE_BUILD_TYPE=RelWithDebInfo', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/tmp/tmp5amlvokb.build-lib/vllm', '-DCMAKE_ARCHIVE_OUTPUT_DIRECTORY=/tmp/tmp537_ioz7.build-temp', '-DVLLM_TARGET_DEVICE=cuda', '-DVLLM_PYTHON_EXECUTABLE=/home/anaconda3/envs/vllm_string/bin/python', '-DNVCC_THREADS=1', '-DCMAKE_JOB_POOL_COMPILE:STRING=compile', '-DCMAKE_JOB_POOLS:STRING=compile=128']' returned non-zero exit status 1.
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building editable for vllm
Failed to build vllm
ERROR: Failed to build installable wheels for some pyproject.toml based projects (vllm)The vllm build error:
-- Target device: cuda
-- Found Python: /home/anaconda3/envs/vllm_string/bin/python (found version "3.10.16") found components: Interpreter Development.Module Development.SABIModule
-- Found python matching: /home/anaconda3/envs/vllm_string/bin/python.
-- Found CUDA: /usr/local/cuda (found version "12.6")
-- The CUDA compiler identification is unknown
CMake Error at /tmp/pip-build-env-im2k6qe4/overlay/lib/python3.10/site-packages/cmake/data/share/cmake-3.31/Modules/CMakeDetermineCUDACompiler.cmake:266 (message):
Failed to detect a default CUDA architecture.Here is my cude version:
This specific version seems require a specific CUDA version. Could you please share your machine configuation? Or could you please share those files required to modify to impletement vllm_string?
Thank you!
Metadata
Metadata
Assignees
Labels
No labels
