Overview / Compute
GPU infrastructure
Current-generation accelerators in whole machines, built into clusters with a fabric that belongs to one customer at a time. Every part of the system is named, published and inspectable.
The node is the
smallest thing we rent.
An eight-GPU host is never split between customers. A single-GPU instance is a whole, smaller machine — not a slice of a large one.
cl.h200.x8
Sample host spec- Accelerators
- 8× NVIDIA H200 SXM
- GPU memory
- 8 × 141 GB HBM3e · 1.1 TB total
- GPU interconnect
- NVSwitch · 900 GB/s per GPU
- Host CPU
- 2× Xeon Platinum 8480+ · 224 threads
- System memory
- 2 TB
- Local NVMe
- 30.7 TB
- Compute fabric
- 8× 400 Gb/s, one per GPU
- Front-end network
- 2× 100 Gb/s Ethernet
A fabric with
one tenant on it.
Clusters use a rail-optimised two-tier fabric: GPU n in every node connects to leaf switch n, so collective operations stay one hop apart. Each cluster gets its own fabric partition, and its leaf ports are not shared.
- Per-GPU bandwidth
- 400 Gb/s, InfiniBand NDR or RoCEv2
- Oversubscription
- None, leaf to spine
- Isolation
- Partition keys or VRFs per tenant
- Front end
- Separate Ethernet for storage and ingress
Deployment forms
The same hardware, held three ways. What changes is the size of the boundary and how long you keep it.
| Node | Cluster | Enclosure | |
|---|---|---|---|
| Unit | 1–8 GPUs on one host | 16–1,024 GPUs | Dedicated racks or a caged area |
| Tenancy boundary | The whole host | Hosts plus their fabric ports and partition | Physical space, power feed and network edge |
| Compute fabric | NVLink / NVSwitch inside the node | Rail-optimised, 400 Gb/s per GPU, non-blocking | Designed with you; your edge routers |
| Provisioning | Minutes, self-serve | Days, scheduled with you | Weeks, built to specification |
| Term | Per second, or 1–12 month reservation | 1–12 month reservation | 12 months and longer |
| Confidential mode | On supported GPUs | On supported GPUs | On supported GPUs, plus your own HSM |
| Orchestration | Your choice | Managed Slurm or Kubernetes, or bring your own | Your choice, with optional management |
| Physical access | Ours, logged | Ours, logged | Escorted access for your staff |
Software and storage
- Images
- Ubuntu 24.04 LTS with the NVIDIA driver, CUDA, NCCL and Fabric Manager pre-installed — or your own signed image.
- Orchestration
- Managed Slurm or Kubernetes on clusters, with topology-aware scheduling that keeps jobs on the same rails.
- Storage
- Local NVMe on every node; network block volumes and S3-compatible object storage in the same facility.
- Observability
- GPU, fabric and thermal telemetry exported to your Prometheus endpoint. We keep only what operating the hardware requires.