====== Parallelism ======

===== LLNL =====

LLNL (Lawrence Livermore National Laboratory) offers most their training materials [[https://hpc.llnl.gov/training/tutorials|online]]. The workshops focus on parallel programming, parallel tools, and the use of its High Performance Computing (HPC) systems.

===== UD =====
University of Delaware commissioned a three-part lecture series in 2012 covering the basics concepts of parallelism and parallelism on HPC clusters.

==== Part I ====

Topics covered include thinking in parallel, Flynn’s taxonomy, types of parallelism, parallelism basics, \\ design patterns for parallel programs and using GNU gprof. 
([[http://www.udel.edu/it/research/files/cluster/workshop/hpc-lecture-I.pdf|slides]]) ([[https://capture.udel.edu/media/5Mills+Parallelism+I+-+Part+1.mp4/1_17rvck5q|video - part 1]]) ([[https://capture.udel.edu/media/6Mills+Parallelism+I+-+Part+2.mp4/1_39urzw3s|video - part 2]])

==== Part II ====

Topics covered include OpenMP and MPI programming models.([[http://www.udel.edu/it/research/files/cluster/workshop/hpc-lecture-II.pdf|slides]]) ([[https://capture.udel.edu/media/7Mills+Parallelism+II.mp4/1_lap1tlpx|video]])

==== Part III ====

Topics covered include more on MPI, vectorization, OpenACC and OpenCL. ([[http://www.udel.edu/it/research/files/cluster/workshop/hpc-lecture-III.pdf|slides]]) ([[https://capture.udel.edu/media/8Mills+Parallelism+III.mp4/1_yugml4yl|video]])