15. Multiprocessing [HPC in Julia]

In this video we'll introduce the topic of multiprocessing - the second key paradigm of parallel processing in this series. Multiprocessing is a cornerstone of high performance computing, enabling your code to scale efficiently across multiple cores, machines and even entire supercomputing clusters.

In this video, we'll compare multiprocessing and multithreading and give a brief introduction on how to implement multiprocessing code in Julia, using both Distributed.jl (the standard library for distributed processing) and the Message Passing Interface (via MPI.jl).

This module was designed as an MPAGS (Midlands Physics Alliance Graduate School) module and aimed at postgraduates and early career researchers.

Timestamps:
00:00:00 Introduction
00:00:15 Limitations of multithreading
00:01:33 Multiprocessing
00:06:20 Distributed.jl
00:15:34 Benchmarks
00:17:57 Distributed.jl summary
00:19:00 MPI
00:25:34 MPI Communication Modes
00:26:42 MPI Monte-Carlo estimation

Related Series:
   • Introduction to Parallel Computing in Juli...  

Useful links:
Git/GitHub for Researchers:    • MLiS1 Introduction to Git by Jamie Mair  
Course Information Website: https://jamiemair.github.io/mpags-hig...
Julia Documentation: https://docs.julialang.org/en/v1/
MPAGS Registration: https://warwick.ac.uk/fac/sci/physics...
Course Notes: https://jamiemair.co.uk/courses/hpc

#Julia #Multiprocessing #Multithreading #ParallelComputing #HighPerformanceComputing #DistributedComputing #MPI #DistributedJL #MPIjl #Coding #Programming #Supercomputing #ScientificComputing #MPAGS #ResearchComputing #JuliaLang #Benchmarking