Orchestration & Scheduling

GPU scheduler / GPU scheduling

A GPU scheduler decides which workload runs on which GPU (or GPU slice) and when, based on priority, availability, and resource requirements.

Scheduling quality directly determines utilization. A weak scheduler leaves GPUs idle between jobs, while a good one keeps fractional slices and full GPUs both busy.

Related terms

Related resources