A three-part lecture series covering the basics concepts of parallelism and parallelism on HPC clusters.

Topics covered include thinking in parallel, Flynn’s taxonomy, types of parallelism, parallelism basics,
design patterns for parallel programs and using GNU gprof. (slides) (video - part 1) (video - part 2)

Topics covered include OpenMP and MPI programming models.(slides) (video)

Topics covered include more on MPI, vectorization, OpenACC and OpenCL. (slides) (video)