GPU Virtualization & Partitioning

GPU virtualization

GPU virtualization is the practice of abstracting a physical GPU into multiple logical instances so several workloads or tenants can share the same hardware safely and efficiently.

On enterprise platforms, GPU virtualization is what makes it possible to run diverse AI workloads, including training, inference, and rendering, on shared infrastructure without one workload starving another.

How hosted·ai approaches this

hosted·ai's platform is built around software-defined GPU virtualization rather than static hardware partitioning, which is what allows fractional allocation down to a single GPU core. See the Software-Defined GPU whitepaper for the technical approach.

Related terms