CUDA-ready machines for training, inference and rendering, from a single mid-range card to multi-GPU nodes. Drivers preinstalled.
Entry CUDA node for inference and fine-tuning small models.
RTX 4000 Ada from $139 4 options24 GB holds a quantised 30B model comfortably.
RTX 4090 from $229 4 optionsTwo cards, 48 GB combined, for multi-GPU training.
2x RTX 4090 from $429 4 optionsDatacentre silicon with the memory bandwidth to match.
NVIDIA A100 from $549 4 optionsFor anything model-shaped, GPU memory decides what you can run and the core count decides how fast it runs. A 24 GB card holds a quantised 30B model; 48 GB holds it unquantised; below 16 GB you are fine-tuning small models or doing inference on quantised ones. Pick on memory, then on speed.
Plenty of work people buy GPUs for is actually CPU-bound: data preparation, video transcoding with a software encoder, most classical ML. The high-CPU plans cost a fraction of these and will finish sooner. We will say so if you ask.
Ubuntu with the NVIDIA driver and CUDA toolkit already installed, or a bare Debian if you would rather pin your own versions. Docker with the container toolkit configured on request.