Table of Contents

Parallelism

LLNL

LLNL (Lawrence Livermore National Laboratory) offers most their training materials online. The workshops focus on parallel programming, parallel tools, and the use of its High Performance Computing (HPC) systems.

UD

University of Delaware commissioned a three-part lecture series in 2012 covering the basics concepts of parallelism and parallelism on HPC clusters.

Part I

Topics covered include thinking in parallel, Flynn’s taxonomy, types of parallelism, parallelism basics,
design patterns for parallel programs and using GNU gprof. (slides) (video - part 1) (video - part 2)

Part II

Topics covered include OpenMP and MPI programming models.(slides) (video)

Part III

Topics covered include more on MPI, vectorization, OpenACC and OpenCL. (slides) (video)