A node pool is a group of servers (nodes) with similar hardware specifications, such as the same GPU model, managed together as a single scalable unit.
Node pools let platform operators scale a specific GPU type up or down independently, which matters when running mixed fleets, for example H100s for training alongside L40s for inference.
We use cookies for analytics and advertising. Privacy policy