This is an old revision of the document!
Linux/Unix
Basic Linux/Unix skills are needed to use a cluster, emphasizing use of an editor and the command-line interface.
Basics
- Linux Basics I provides a basic introduction of Linux using a command-shell window and command line, not a GUI (mouse) interface. This session explores the details of the command-shell window, command line input and output, and overall command syntax including wildcards and redirection for STDIN and STDOUT. You will also learn how to get help, the basics of files, directories and permissions, and what editors are available to create and edit files.(slides) (video)
- Linux Basics II provides a basic introduction to the bash shell and scripting with bash and Python. (video)
- An example script project is used to explain the basic bash scripting concepts. It is based on using the Gnuplot program which reads a command file to create a data file and write an image file as an x-y plot. Firefox is used to view the image. (slides)
- A basic Python script is used to demonstrate Python scripting and how to call it from a bash script. (slides)
Recommended tutorials
Tutorials developed at the University of Delaware:
- Learning the vi text editor (University of Delaware)
- Introduction to Unix/Linux (Part 2): Variables and Environments, Aliases, Permissions (University of Delaware)
- Regular Expressions (University of Delaware) - Additional note
- Introduction to Shell Scripting (Part 1) (University of Delaware) [as a PDF]
- Introduction to Shell Scripting (Part 2) (University of Delaware) [as a PDF]
- Modular Environment Management with VALET (University of Delaware) [as a PDF]
- Introduction to Grid Engine (University of Delaware) [as a PDF]
- Matlab: Batch Script and Compiled Array Job (University of Delaware) [as a PDF]
- Python Programming (Part 1) (University of Delaware)
- Python Programming (Part 2) (University of Delaware)
- Python Packages - matplotlib (University of Delaware) - Example files: sine_plot.py, fit_test1.py, fit_test2.py
- Making the Most of Farber: Storage and Standby (University of Delaware) [as a PDF]
- Compilers: On UD HPC Community Clusters (University of Delaware)
- Matlab Compiler: On UD HPC Community Clusters (University of Delaware)
- Unix Software Development Basics: Project Structure and Build Management with Make (University of Delaware) [as a PDF]
- Unix Software Development Basics: Autotools and Cmake (University of Delaware) [as a PDF]
- Building and Installing Software: On UD HPC Community Clusters (University of Delaware)
- Revision Control and Git (University of Delaware)
- Software Management with VALET (University of Delaware) [as a PDF]
HPC presentations at the University of Delaware:
- Coupled Regional Weather Modeling Using UD HPC Resources (University of Delaware, Joseph Brodie)
- WRF-ARW on Farber (University of Delaware, Carly Buxton)
- History of CESM and getting it to work on Mills (University of Delaware, Brian Hanson)
Other tutorials:
Basics
- Index of Linux and Unix Commands (Computer Hope)
- UNIX Tutorial (UC Berkeley School of Information)
- Unix Tutorial for Beginners (U. Surrey, UK)
- Linux (for HPC) Basics (ORNL National Lab)
- Bash Scripting Tutorial (Linuxconfig.org)
- Advanced Bash-Scripting Guide (The Linux Documentation Project)
- Regular Expressions Tutorial (RegexOne.com)
Editors
- Interactive Vim tutorial (henrik.huttunen@gmail.com)
- Vi For Smarties (jerry_y_wang@yahoo.com)
- A Guided Tour of Emacs (GNU Operating System)