Cannot install pytorch and cannot enable to use gpu

didem1 · 2025-11-03T07:23:55.098Z

Hi there.
I have jetson agx orin developer kit 64 GB with Ubuntu 22.04. I have setup a Ubuntu 24.04 docker container. Currently nvidia-smi from the container returns that the driver version is 540.4.0 and CUDA version is 12.6. nvcc also indicates CUDA version as 12.6. I created the container with --gpus=all and --runtime=nvidia.
The problem I have is that I cannot install compatible pytorch.
When I follow the nvidia documentation Installing PyTorch for Jetson Platform - NVIDIA Docs I keep getting the following error:
ERROR: HTTP error 404 while getting https://developer.download.nvidia.com/compute/redist/jp/v621/pytorch/2.8.0a0+5228986c39
…

image811×152 27 KB

I can install pytorch with their classic way but some packages keeps giving errors related to pytorch.
Torch returns following informations
Is CUDA available : True
CUDA Home address : /usr/local/cuda-12.6
Device : cuda

But keeps saying that gpu not detected.

I have nvidia jetpack 6.2 in my host but wasn’t able to install to the container.