Fractional GPU (or GPU slicing) is the allocation of less than one full GPU's compute or memory to a workload, so multiple lightweight jobs can share a single card.
This is the core mechanism behind higher GPU utilization on enterprise platforms. Most inference and dev/test workloads never need a full GPU, so slicing turns idle capacity into billable capacity.
We use cookies for analytics and advertising. Privacy policy