Visualizing job usage on the Compute Canada systems with the ViewClust Python package

Compute Canada account usage via the Slurm scheduler is a dominant factor that is used the determine the priority of each job that enters the queue. The priority of each job may have substantial influence on the wait time in the queue. Understanding the usage pattern of an account on the Compute Canada systems can help establish expectations for throughput and also help determine if alternative job submission strategies could result in shorter wait times, shorter time to results, and/or higher throughput. The "sacct" command in Slurm provides information required for assessing an account's usage on the system, but the tabular data can be difficult to summarize and use to generate the relevant usage measures that are used to calculate job priority by the scheduler. ViewClust is a Python package being developed by SHARCNET staff to summarize and interactively visualize job usage data. This general interest webinar describes the summary figures and measures made available by the ViewClust package and provides a demonstration of its usage on Compute Canada systems.
_______________________________________­________


This webinar was presented by James Desjardins (SHARCNET) on July 15th, 2020, as a part of a series of regular biweekly General Interest webinars ran by SHARCNET. The webinars cover different high performance computing (HPC) topics, are approximately 45 minutes in length, and are delivered by experts in the relevant fields. Further details can be found on this web page: https://www.sharcnet.ca/help/index.ph... . Subscribe to our twitter account (@SHARCNET) to stay updated about our upcoming webinars.

SHARCNET is a consortium of 19 Canadian academic institutions who share a network of high performance computers (http://www.sharcnet.ca). SHARCNET is a part of Compute Ontario (http://computeontario.ca/) and Compute Canada (https://computecanada.ca).