Differences

This shows you the differences between two versions of the page.

--- training:hpc:hpc [2018-03-22 14:38] – created anita
+++ training:hpc:hpc [2024-05-13 13:31] (current) – [HPC Basics] anita
@@ Line 1: / Line 1: @@
 ===== HPC =====
-==== Recommended HPC tutorials ====
+==== HPC Basics ====
+**Introduction to HPC workshop** is an introduction to HPC (High Performance Computing) covering basic concepts such as connecting and SSH keys, workgroups, HPC components, file systems, data management, data transfer methods, software and VALET, and running jobs with Slurm presented by the UDIT Research CyberInfrastructure group.([[http://www.udel.edu/it/research/files/cluster/workshop/IntroToHPC_2024.pdf|slides]])([[https://capture.udel.edu/media/Introduction+to+HPC+workshop/1_d2ndqci1|video]])
+[[https://hpc-carpentry.github.io/|HPC Carpentry]] teaches basic skills for high-performance computing. HPC Carpentry is a set of teaching materials designed to help new users take advantage of high-performance computing systems. No prior computational experience is required. These lessons are ideal for either traditional or online workshop, or independent (self-paced) study.
+[[https://hpc-carpentry.github.io/hpc-intro/|Introduction to High-Performance Computing]] is a great place to start (up to lesson 7). The remaining lessons can be referenced for concepts, but are not specific to UD's community clusters.  Also consider the [[http://swcarpentry.github.io/shell-novice/|Software Carpentry: The Unix Shell]] workshop to provide additional in depth knowledge for lessons 1-7.
+** NOTE: Currently, HPC Carpentry release is a draft. Comments and feedback are welcome.**
+<note tip>If you would like to schedule an online workshop for your research group based on using the materials from [[https://hpc-carpentry.github.io/|HPC Carpentry]] or [[https://software-carpentry.org/|Software Carpentry]], please [[http://www1.udel.edu/deptforms/it/research_computing/index.html|submit an HPC Request Form]].</note>
+=== Supercomputing in Plain English at Oklahoma University (OU) ===
+Henry Neeman at OU is hosting an annual set of workshops about High Performance Computing called [[http://www.oscer.ou.edu/education.php|Supercomputing in Plain English]]. Learn more about how supercomputers work and how to use them by watching and participating through exercises. All the videos and slides are available [[http://www.oscer.ou.edu/education.php|here]].
+==== Getting started on a UD Cluster ====
+Teaches you how to get started using the UD's HPC community clusters specifically focusing on the differences from a standard Linux system.
+   * **Caviness**: [[http://www.udel.edu/it/research/files/cluster/workshop/Caviness-HPC-Basics.pdf|Caviness HPC Basics]]
+   * **Farber**: [[http://www.udel.edu/it/research/files/cluster/workshop/Farber-HPC-Basics.pdf|Farber HPC Basics]]
+==== Recommended HPC tutorials and presentations ====
+=== Tutorials developed at the University of Delaware ===
+  * [[http://www.udel.edu/it/research/files/cluster/workshop/vi.pdf|Learning the vi text editor]] (University of Delaware)
+  * [[http://www.udel.edu/it/research/files/cluster/workshop/intro-unix-linux-2.pdf|Introduction to Unix/Linux (Part 2): Variables and Environments, Aliases, Permissions]] (University of Delaware)
+  * [[http://www.udel.edu/it/research/files/cluster/workshop/regex.pdf|Regular Expressions]] (University of Delaware) - [[Additional note]]
+  * [[http://www.hpc.udel.edu/presentations/shell_scripting_pt1|Introduction to Shell Scripting (Part 1)]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/shell_scripting_pt1/shell_scripting_pt1.pdf|PDF]]]
+  * [[http://www.hpc.udel.edu/presentations/shell_scripting_pt2|Introduction to Shell Scripting (Part 2)]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/shell_scripting_pt2/shell_scripting_pt2.pdf|PDF]]]
+  * [[http://www.hpc.udel.edu/presentations/valet|Modular Environment Management with VALET]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/valet/valet.pdf|PDF]]]
+  * [[http://www.hpc.udel.edu/presentations/gridengine_intro|Introduction to Grid Engine]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/gridengine_intro/gridengine_intro.pdf|PDF]]]
+  * [[http://www.hpc.udel.edu/presentations/matlab_batch_mcr/|Matlab: Batch Script and Compiled Array Job]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/matlab_batch_mcr/matlab_batch_mcr.pdf|PDF]]]
+  * [[http://www.udel.edu/it/research/files/cluster/workshop/Introduction_to_Python_Environments.pdf|Python Environments]] (University of Delaware)
+  * [[http://www.udel.edu/it/research/files/cluster/workshop/Python_Part1.pdf|Python Programming (Part 1)]] (University of Delaware)
+  * [[http://www.udel.edu/it/research/files/cluster/workshop/Python_Part2.pdf|Python Programming (Part 2)]] (University of Delaware)
+  * [[http://www.udel.edu/it/research/files/cluster/workshop/python_packages_20115.pdf|Python Packages - matplotlib]] (University of Delaware) - Example files: [[http://www.udel.edu/it/research/files/cluster/workshop/sine_plot.py|sine_plot.py]], [[http://www.udel.edu/it/research/files/cluster/workshop/fit_test1.py|fit_test1.py]], [[http://www.udel.edu/it/research/files/cluster/workshop/fit_test2.py|fit_test2.py]]
+  * [[http://www.hpc.udel.edu/presentations/making_most_of_farber/|Making the Most of Farber: Storage and Standby]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/making_most_of_farber/making_most_of_farber.pdf|PDF]]]
+  * [[http://www.hpc.udel.edu/presentations/mills-spillover/|Mills: Job Scheduling Change (Spillover Queue)]]
+  * [[http://www.udel.edu/it/research/files/cluster/workshop/Compilers.pdf|Compilers: On UD HPC Community Clusters]] (University of Delaware)
+  * [[http://www.udel.edu/it/research/files/cluster/workshop/MATLAB_Compiler.pdf|Matlab Compiler: On UD HPC Community Clusters]] (University of Delaware)
+  * [[http://www.hpc.udel.edu/presentations/software-dev-part1/|Unix Software Development Basics: Project Structure and Build Management with Make]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/software-dev-part1/software-dev-part1.pdf|PDF]]]
+  * [[http://www.hpc.udel.edu/presentations/software-dev-part2/|Unix Software Development Basics: Autotools and Cmake]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/software-dev-part2/software-dev-part2.pdf|PDF]]]
+  * [[http://www.udel.edu/it/research/files/cluster/workshop/Building_and_Installing_Software.pdf|Building and Installing Software: On UD HPC Community Clusters]] (University of Delaware)
+  * [[http://www.udel.edu/it/research/files/cluster/workshop/Revision_Control_and_GIT.pdf|Revision Control and Git]] (University of Delaware)
+  * [[http://www.hpc.udel.edu/presentations/software_management/|Software Management with VALET]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/software_management/software_management.pdf|PDF]]]
+  * [[http://www.hpc.udel.edu/presentations/openfoam-intro/|Using OpenFOAM on the Community Cluster]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/openfoam-intro/openfoam-intro.pdf|PDF]]]
+=== Presentations from the University of Delaware ===
+  * [[http://www.udel.edu/it/research/files/cluster/workshop/hpc_JFB_Apr2015.pdf|Coupled Regional Weather Modeling Using UD HPC Resources]] (University of Delaware, Joseph Brodie)
+  * [[http://www.udel.edu/it/research/files/cluster/workshop/hpc_Buxton_Apr2015.pdf|WRF-ARW on Farber]] (University of Delaware, Carly Buxton)
+  * [[http://www.udel.edu/it/research/files/cluster/workshop/hpc_hanson_Apr2015.pdf|History of CESM and getting it to work on Mills]] (University of Delaware, Brian Hanson)
+=== Other HPC tutorials ===
+   * [[https://hpc-carpentry.github.io/hpc-intro/|Introduction to High Performance Computing (HPC)]] (HPC Carpentry)
    * [[http://www.citutor.org/browse.php|Cyber-Infrastructure Tutor (National Center for Supercomputing Applications)]]
    * [[http://www.osc.edu/supercomputing/training/|Ohio Supercomputing Center workshops]]