---
title: Installing NVIDIA Driver and CUDA 12.9 for Tesla V100 on Ubuntu 24.04 VM in Proxmox VE
description: "Proxmox VE / Ubuntu 24.04 / NVIDIA CUDA # Installing NVIDIA Driver and CUDA 12.9 on Tesla V100 in Ubuntu 24.04 VM on Proxmox VE This is a guide to PCIe passthrough Tesla V100 to an OVMF virtual machine on…"
url: "https://bestnetllc.co.jp/en/docs/installing-nvidia-driver-and-cuda-12-9-for-tesla-v100-on-ubuntu-24-04-vm-in-proxmox-ve/"
updated: "2026-10-19"
category: "Tech Blog / GPU & LLM Infrastructure"
---

# Installing NVIDIA Driver and CUDA 12.9 for Tesla V100 on Ubuntu 24.04 VM in Proxmox VE

Proxmox VE / Ubuntu 24.04 / NVIDIA CUDA

# Installing NVIDIA Driver and CUDA 12.9 on Tesla V100 in Ubuntu 24.04 VM on Proxmox VE

This is a guide to PCIe passthrough Tesla V100 to an OVMF virtual machine on Proxmox VE and install
NVIDIA driver and CUDA Toolkit 12.9 on the Ubuntu 24.04 side.
It also includes workarounds for `BAR0 is 0M @ 0x0` /
`This PCI I/O region assigned to your NVIDIA device is invalid`
which are common in OVMF environments.

Target GPU: Tesla V100
Guest OS: Ubuntu 24.04 LTS
Virtualization: Proxmox VE / KVM
Boot Method: OVMF (UEFI)

## Prerequisites for This Article

- IOMMU / VFIO settings on the Proxmox host side are already complete
- GPU passthrough to guest is functional
- Guest OS is Ubuntu 24.04 LTS
- This article assumes a compute-use VM

## Verification Configuration

Hypervisor
Proxmox VE / KVMVM BIOS
OVMF (UEFI)Machine Type
q35GPU
Tesla V100 PCIe 32GBGuest OS
Ubuntu 24.04 LTSCUDA Toolkit
12.9

## Why Use CUDA 12.9

Tesla V100 is a Volta-generation GPU. Starting with CUDA 13 and later, offline compilation and
library support for Volta have been dropped, so it is safer to keep the V100 development environment
fixed on CUDA 12.x series. This article uses CUDA Toolkit 12.9.

STEP 1

## Configure VM on Proxmox Side for GPU Passthrough

First, configure the virtual machine for GPU passthrough.
If OVMF / q35 / Host PCI settings are already complete, proceed to the next step.

```bash
qm stop 101
qm set 101 --bios ovmf
qm set 101 --machine q35
qm set 101 --hostpci0 65:00,pcie=1
qm start 101
```

**Note:** `101` is the VMID example, `65:00` is a GPU PCI address example.
Replace with values from your actual environment.

STEP 2

## Expand MMIO Aperture in OVMF Environment

This is the biggest pitfall. In OVMF UEFI VMs, GPU BAR resources are often not sufficiently mapped,
resulting in `BAR0 is 0M @ 0x0` or
`This PCI I/O region assigned to your NVIDIA device is invalid`.
In such cases, add `X-PciMmio64Mb` to
expand the MMIO aperture.

Adding this setting actually resolved the issue where
`nvidia-smi` failed to work properly on OVMF virtual machines in Proxmox.

```bash
qm stop 101
qm set 101 --args '-fw_cfg name=opt/ovmf/X-PciMmio64Mb,string=262144'
qm start 101
```

**Key Point:** After the change, perform a
**complete VM shutdown and then start it again**, not just a guest OS reboot.

STEP 3

## Install Required Packages on Ubuntu 24.04

Before installing the NVIDIA driver and CUDA Toolkit, install kernel headers and build-related tools.

```bash
sudo apt update
sudo apt install -y linux-headers-$(uname -r) gcc g++ make wget pciutils
```

STEP 4

## Add NVIDIA Official Repository

Add the NVIDIA official APT repository for Ubuntu 24.04.

```bash
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/cuda-keyring_1.1-1_all.deb
sudo dpkg -i cuda-keyring_1.1-1_all.deb
sudo apt update
```

STEP 5

## Install NVIDIA Driver

Fix the driver to the 580 series before installation. V100 is still supported by the 580 series.

```bash
sudo apt install -y nvidia-driver-pinning-580
sudo apt install -y cuda-drivers
```

If you want a compute-only configuration without GUI, you can also
switch to a minimal `libnvidia-compute` and `nvidia-dkms`-based setup
depending on your use case, but it is clearer to first verify normal operation with `cuda-drivers`.

STEP 6

## Fix and Install CUDA Toolkit 12.9

To avoid tracking the latest CUDA version, use the metapackage `cuda-toolkit-12-9` to
lock to the 12.9 series.

```bash
sudo apt install -y cuda-toolkit-12-9
```

**If Capacity is Tight:** The full Toolkit is quite large, so you can start
with just runtime and compiler.

```bash
sudo apt install -y cuda-runtime-12-9 cuda-compiler-12-9
# Add development libraries later if needed
sudo apt install -y cuda-libraries-dev-12-9
```

STEP 7

## Set PATH and Reboot

Set PATH and library path to make `nvcc` easier to use, then reboot.

```bash
echo 'export PATH=/usr/local/cuda/bin:$PATH' >> ~/.bashrc
echo 'export LD_LIBRARY_PATH=/usr/local/cuda/lib64:$LD_LIBRARY_PATH' >> ~/.bashrc
sudo reboot
```

STEP 8

## Verify Operation

After reboot, verify that the GPU is visible, the driver loads properly,
and CUDA compiler is usable.

```bash
source ~/.bashrc
uname -r
lspci | grep -i nvidia
nvidia-smi
nvidia-smi -L
nvcc --version
dmesg -T | grep -E 'NVRM|BAR0|nvidia'
```

If installed correctly, `nvidia-smi` will display the Tesla V100,
and `nvcc --version` will display CUDA 12.9.

## Troubleshooting

### `BAR0 is 0M @ 0x0` Appears

This is almost certainly an OVMF MMIO aperture shortage. First, apply
`qm set 101 --args '-fw_cfg name=opt/ovmf/X-PciMmio64Mb,string=262144'`,
perform a complete VM shutdown, and then start it again.

### `nvidia-smi` Cannot Communicate with Driver

The driver kernel module may not have loaded. First, review the OVMF MMIO
settings, then check the module status.

```bash
lsmod | grep -E 'nvidia|nouveau'
sudo journalctl -k -b | grep -Ei 'nvidia|nouveau|secure|module verification'
```

### Disk Space Runs Out During Toolkit Installation

The full Toolkit is large, so installation may fail midway on a VM with limited free space.
In that case, clean the cache and switch to a minimal package configuration for safety.

```bash
df -h /
sudo apt clean
sudo apt autoremove -y
sudo apt --fix-broken install
```

## Summary

Installing NVIDIA driver and CUDA Toolkit on a Tesla V100 in an Ubuntu 24.04 VM
on Proxmox VE is not difficult in itself. However, on OVMF virtual machines,
insufficient MMIO aperture can prevent the NVIDIA driver from starting, so
configuring `X-PciMmio64Mb` becomes a practical key point.

When building the same configuration going forward, it is best to configure
**OVMF / q35 / PCIe** and
**MMIO aperture expansion** together from the start.

## Reference Information

- [CUDA Installation Guide for Linux](https://docs.nvidia.com/cuda/cuda-installation-guide-linux/)
- [NVIDIA Driver Installation Guide for Ubuntu](https://docs.nvidia.com/datacenter/tesla/driver-installation-guide/ubuntu.html)
- [Known Issues with Large BAR in KVM/UEFI VM](https://docs.nvidia.com/vgpu/latest/known-issues/bug-200719557-vgpu-graphics-driver-fails-to-load-linux-kvm-vm.html)
- [Proxmox VE PCI(e) Passthrough](https://pve.proxmox.com/wiki/PCI%28e%29_Passthrough)

## Disclaimer

This article has been created based on the verification environment at the time of writing. We do not warrant
the accuracy, completeness, usefulness, or operation in specific environments of the content described.
The procedures and behavior described may differ depending on version differences or update status of OS, kernel, GPU, firmware, BIOS/UEFI, Proxmox VE,
NVIDIA driver, CUDA Toolkit, etc.

- The procedures in this article include GPU passthrough, kernel module installation, and startup configuration changes.
- Before implementation, prepare backup, snapshot, and maintenance plans and verify thoroughly in a test environment.
- We are not responsible for any defects, downtime, failures, data loss, or other damages caused by using the content of this article.
- Implementation in production environments is at the user’s discretion and responsibility.
- Product names, service names, and company names mentioned are trademarks or registered trademarks of their respective companies.