NVIDIA Terraform Modules provide a reference architecture for deploying CSP managed Kubernetes clusters equipped with NVIDIA softwares:
- NVIDIA GPU Operator.
- NVIDIA NIM Operator.
All the components listed below have been tested successfully together.
When NVIDIA Terraform Modules is released, the previous release enters maintenance support and only receives patch release updates. All prior batches enter end-of-life (EOL) and are no longer supported and do not receive patch updates.
| Release | Status |
|---|---|
| 25.4.0 | Generally Available |
| 24.11.0 | Maintenance |
The Kubernetes clusters provisioned by the modules in this repository provide tested and certified versions of Kubernetes, the NVIDIA GPU operator, and NVIDIA NIM Operator.
If your application does not require a specific version of Kubernetes, we recommend using the latest available version. We also recommend you plan to upgrade your version of Kubernetes at least every 6 months.
NVIDIA Terraform Modules 25.4.0 Release:
| TF Modules | K8s 1.32 | K8s 1.31 | K8s 1.30 |
|---|---|---|---|
| Platforms | Amazon EKS Azure AKS Google GKE |
Amazon EKS Azure AKS Google GKE |
Amazon EKS Azure AKS Google GKE |
| Supported OS | Ubuntu 24.04 LTS (GKE) Ubuntu 22.04 LTS (AKS/EKS) |
Ubuntu 24.04 LTS (GKE) Ubuntu 22.04 LTS (AKS/EKS) |
Ubuntu 24.04 LTS (GKE) Ubuntu 22.04 LTS (AKS/EKS) |
| Kernel | EKS: 6.8.0-1024-aws AKS: 5.15.0-1082-azure GKE: 6.8.0-1017-gke |
EKS: 6.8.0-1024-aws AKS: 5.15.0-1082-azure GKE: 6.8.0-1017-gke |
EKS: 6.8.0-1024-aws AKS: 5.15.0-1082-azure GKE: 6.8.0-1017-gke |
| Containerd | EKS: 1.7.24 AKS: 1.7.26-1 GKE: 1.7.24 |
EKS: 1.7.24 AKS: 1.7.26-1 GKE: 1.7.24 |
EKS: 1.7.24 AKS: 1.7.26-1 GKE: 1.7.24 |
| CNI | CSP dependent | CSP dependent | CSP dependent |
| CSI | CSP dependent | CSP dependent | CSP dependent |
| NVIDIA GPU Operator | 25.3.0 | 25.3.0 | 25.3.0 |
| NVIDIA GPU Operator Operands | NVIDIA Container Toolkit: 1.17.5 NVIDIA Device Plugin: 0.17.1 NVIDIA MIG Manager: 0.12.1 NVIDIA DCGM Exporter: 4.1.1-4.0.4 |
NVIDIA Container Toolkit: 1.17.5 NVIDIA Device Plugin: 0.17.1 NVIDIA MIG Manager: 0.12.1 NVIDIA DCGM Exporter: 4.1.1-4.0.4 |
NVIDIA Container Toolkit: 1.17.5 NVIDIA Device Plugin: 0.17.1 NVIDIA MIG Manager: 0.12.1 NVIDIA DCGM Exporter: 4.1.1-4.0.4 |
| NVIDIA DataCenter Driver | 570.124.06 | 570.124.06 | 570.124.06 |
| NVIDIA NIM Operator | 1.0.1 | 1.0.1 | 1.0.1 |
| Helm | 3.17.2 | 3.17.2 | 3.17.2 |
Each CSP has its own end of life date for the versions of Kubernetes they support. For more information see:
Infrastructure as code for GPU accelerated managed Kubernetes clusters. These scripts automate the deployment of GPU-Enabled Kubernetes clusters on various cloud service platforms.
Terraform is an open-source infrastructure as code software tool that we will use to automate the deployment of Kubernetes clusters with the required add-ons to enable NVIDIA GPUs. This repository contains Terraform modules, which are sets of Terraform configuration files ready for deployment. The modules in this repository can be incorporated into existing Terraform-managed infrastructure, or used to set up new infrastructure from scratch. You can learn more about Terraform here.
You can download Terraform (CLI) here.
Clone the repo
git clone https://github.com/NVIDIA/nvidia-terraform-modules.git
Select the CSP managed K8s cluster and follow steps indicated in the corresponding page:
- Create an EKS Cluster
- Create an AKS Cluster
- Create a GKE Cluster
These modules do not set up state management for the generated Terraform state file, deleting the statefile (terraform.tfstate) generated by Terraform could result in cloud resources needing to be manually deleted. We strongly encourage you configure remote state.
Please see the Terraform Documentation for more information.
Pull requests are welcome! Please see our contribution guidelines.
Please open an issue on the GitHub project for any questions. Your feedback is appreciated.