Bin packing is a scheduling strategy that places workloads as tightly as possible onto the fewest GPUs necessary, minimizing fragmented, unusable leftover capacity.
Poor placement can leave many GPUs partially occupied but unable to fit any new job. Good bin-packing algorithms are what let a scheduler consistently hit high utilization.
We use cookies for analytics and advertising. Privacy policy