Slurm in Action: Batch Processing for the 21st Century (Georg Rath, NERSC)

(part of series of talks at HPC-UGent on Feb 2nd 2018, see https://www.ugent.be/hpc/en/training/...)

This talk will give an overview over how we use Slurm to schedule the workloads of over 6000 scientists at NERSC, while providing high throughput, ease of use and ultimately user satisfaction.

With the emergence of data-intensive applications it was necessary to update the classic scheduling infrastructure to handle things like user defined software stacks (read: containers), data movement and storage provisioning. We did all of this and more through facilities provided by Slurm. In addition to these features we will discuss priority management and quality of service and how that can greatly improve the user experience of computational infrastructures.