OS Images
FPT public image is built by FPT that you can use to get started quickly with any of the GPU VM available. This image comes with several components needed for AI workloads and selects Ubuntu as the Operating System (OS).
The versions of the installed dependencies are optimized for compatibility and might not be the latest versions available.
Ubuntu 22.04
Ubuntu version 22.04 and essential NVIDIA GPU drivers
NVIDIA Driver 560.35.03 NVIDIA CUDA Toolkit 12.6.85 NVIDIA Fabric Manager (NVSwitch Driver) 560.35 NVIDIA Datacenter GPU Manager 3.3.9
Ubuntu 24.04
Ubuntu version 24.04 and essential NVIDIA GPU drivers
NVIDIA Driver 575 NVIDIA CUDA Toolkit 12.9 NVIDIA Container Toolkit 1.18.2
Ubuntu 24.04 - Inference Optimized
Ubuntu version 24.04, Deploy any model faster with production-grade-performance
NVIDIA Driver 575.51.03 NVIDIA CUDA Toolkit 12.9 NVIDIA Container Toolkit 1.18.2 Docker CE vLLM 0.10.2
Ubuntu 24.04 Inference Optimized v1.1
Ubuntu version 24.04, with vLLM inference engine for high-throughput, production-grade model serving.
NVIDIA Driver 595
NVIDIA CUDA Compute library
NVIDIA DKMS kernel module
NVIDIA GPU kernel driver
CUDA Toolkit 13.1
vLLM v0.20.2
Last updated
Was this helpful?
