| Both sides previous revision Previous revision Next revision | Previous revision |
| training:linux:linux [2018-03-22 14:49] – anita | training:linux:linux [2024-05-13 13:38] (current) – [Basics] anita |
|---|
| ==== Basics ==== | ==== Basics ==== |
| |
| * **Linux Basics I** provides a basic introduction of Linux using a command-shell window and command line, not a GUI (mouse) interface. This session explores the details of the command-shell window, command line input and output, and overall command syntax including wildcards and redirection for STDIN and STDOUT. You will also learn how to get help, the basics of files, directories and permissions, and what editors are available to create and edit files.([[http://www.udel.edu/it/research/files/cluster/workshop/Mills-Linux-Basics-I.pdf|slides]]) ([[http://udcapture.udel.edu/misc/it-css/?t=5dc782643bdba1d8419970b8f9738888|video]]) | **Introduction to Linux/Unix workshop** is an introduction to the Linux/Unix operating system covering basic concepts such as the CLI (command-line interface), files and directories, input/output redirection, file permissions, data transfer, file compression/decompression, shell scripts and environment variables presented by the UDIT Research CyberInfrastructure group.([[http://www.udel.edu/it/research/files/cluster/workshop/LinuxIntro_2024.pdf|slides]]) |
| * **Linux Basics II** provides a basic introduction to the bash shell and scripting with bash and Python. ([[http://udcapture.udel.edu/misc/HPC-tutorial/?t=b51b6cee223df19802de485d356109c3|video]]) | {[[https://capture.udel.edu/media/April%202024%3A%20Introduction%20to%20Linux_Unix%20Workshop/1_dlg61fp9|video]]) |
| | |
| | The [[http://swcarpentry.github.io/shell-novice/|Software Carpentry: The Unix shell]] workshop will get you started with using Linux/Unix. It will help you combine existing programs in new ways and automate repetitive tasks so you aren’t typing the same things over and over again. Use of the shell is fundamental to using a wide range of other powerful tools and computing resources, including high performance computing (HPC). These lessons will start you on a path towards using these resources effectively. |
| | |
| | * **Linux Basics I** provides a basic introduction of Linux using a command-shell window and command line, not a GUI (mouse) interface. This session explores the details of the command-shell window, command line input and output, and overall command syntax including wildcards and redirection for STDIN and STDOUT. You will also learn how to get help, the basics of files, directories and permissions, and what editors are available to create and edit files.([[http://www.udel.edu/it/research/files/cluster/workshop/Mills-Linux-Basics-I.pdf|slides]]) ([[https://capture.udel.edu/media/1Mills+Linux+Basics+I.mp4/1_11r1ektj|video]]) |
| | * **Linux Basics II** provides a basic introduction to the bash shell and scripting with bash and Python. ([[https://capture.udel.edu/media/2Mills+Linux+Basics+II.mp4/1_wj23ptfe|video]]) |
| * An example script project is used to explain the basic bash scripting concepts. It is based on using the Gnuplot program which reads a command file to create a data file and write an image file as an x-y plot. Firefox is used to view the image. ([[http://www.udel.edu/it/research/files/cluster/workshop/Mills-Linux-Basics-II.pdf|slides]]) | * An example script project is used to explain the basic bash scripting concepts. It is based on using the Gnuplot program which reads a command file to create a data file and write an image file as an x-y plot. Firefox is used to view the image. ([[http://www.udel.edu/it/research/files/cluster/workshop/Mills-Linux-Basics-II.pdf|slides]]) |
| * A basic Python script is used to demonstrate Python scripting and how to call it from a bash script. ([[http://www.udel.edu/it/research/files/cluster/workshop/Mills-Linux-Basics-II-python.pdf|slides]]) | * A basic Python script is used to demonstrate Python scripting and how to call it from a bash script. ([[http://www.udel.edu/it/research/files/cluster/workshop/Mills-Linux-Basics-II-python.pdf|slides]]) |
| ==== Recommended tutorials for Linux/Unix Basics ==== | ==== Recommended tutorials for Linux/Unix Basics ==== |
| |
| | * [[http://swcarpentry.github.io/shell-novice/|The Unix Shell]] (Software Carpentry) |
| | * [[ http://explainshell.com/|Tool to dissect any shell command you type in and display help text for each piece]] (explainshell.com) |
| | * [[http://linuxcommand.org/lc3_learning_the_shell.php|Leaning the Shell]] (LinuxCommand.org) |
| | * [[http://linuxcommand.org/lc3_writing_shell_scripts.php|Writing Shell Scripts]] (LinuxCommand.org) |
| * [[http://www.computerhope.com/unix.htm#04|Index of Linux and Unix Commands]] (Computer Hope) | * [[http://www.computerhope.com/unix.htm#04|Index of Linux and Unix Commands]] (Computer Hope) |
| * [[http://people.ischool.berkeley.edu/~kevin/unix-tutorial/toc.html|UNIX Tutorial]] (UC Berkeley School of Information) | * [[http://people.ischool.berkeley.edu/~kevin/unix-tutorial/toc.html|UNIX Tutorial]] (UC Berkeley School of Information) |
| * [[http://www.ee.surrey.ac.uk/Teaching/Unix/|Unix Tutorial for Beginners]] (U. Surrey, UK) | * [[http://www.ee.surrey.ac.uk/Teaching/Unix/|Unix Tutorial for Beginners]] (U. Surrey, UK) |
| * [[https://www.nics.tennessee.edu/files/pdf/hpcss14_15/11_13_IntroToLinux.pdf|Linux (for HPC) Basics]] (ORNL National Lab) | * [[https://www.nics.tennessee.edu/files/pdf/hpcss14_15/11_13_IntroToLinux.pdf|Linux (for HPC) Basics]] (ORNL National Lab) |
| * [[http://www.linuxconfig.org/Bash_scripting_Tutorial|Bash Scripting Tutorial]] (Linuxconfig.org) | |
| * [[http://tldp.org/LDP/abs/html/|Advanced Bash-Scripting Guide]] (The Linux Documentation Project) | * [[http://tldp.org/LDP/abs/html/|Advanced Bash-Scripting Guide]] (The Linux Documentation Project) |
| * [[http://www.vtc.com/products/Unix-Shell-Fundamentals-tutorials.htm|Unix Shell Fundamentals]] ([[http://www.it.udel.edu/learnit/online-training-resources| request vtc.com account]]) | * [[http://www.vtc.com/products/Unix-Shell-Fundamentals-tutorials.htm|Unix Shell Fundamentals]] ([[http://www.it.udel.edu/learnit/online-training-resources| request vtc.com account]]) |
| ==== Recommended tutorials for Linux/Unix Editors ==== | ==== Recommended tutorials for Linux/Unix Editors ==== |
| | |
| * [[http://www.udel.edu/001401|The Beginner’s Guide to Nano, the Linux Command-Line Text Editor]] (How-to Geek) | * [[https://www.howtogeek.com/42980/the-beginners-guide-to-nano-the-linux-command-line-text-editor/|The Beginner’s Guide to Nano, the Linux Command-Line Text Editor]] (How-to Geek) |
| * [[http://www.openvim.com/tutorial.html|Interactive Vim tutorial]] (henrik.huttunen@gmail.com) | * [[http://www.openvim.com/tutorial.html|Interactive Vim tutorial]] (henrik.huttunen@gmail.com) |
| * [[http://www.jerrywang.net/vi/|Vi For Smarties]] (jerry_y_wang@yahoo.com) | * [[http://jerrywang.net/vi/|Vi For Smarties]] (jerry_y_wang@yahoo.com) |
| * [[http://www.gnu.org/software/emacs/tour/|A Guided Tour of Emacs]] (GNU Operating System) | * [[http://www.gnu.org/software/emacs/tour/|A Guided Tour of Emacs]] (GNU Operating System) |
| |
| ==== Recommended HPC tutorials and presentations ==== | |
| |
| Tutorials developed at the University of Delaware: | |
| |
| * [[http://www.udel.edu/it/research/files/cluster/workshop/vi.pdf|Learning the vi text editor]] (University of Delaware) | |
| * [[http://www.udel.edu/it/research/files/cluster/workshop/intro-unix-linux-2.pdf|Introduction to Unix/Linux (Part 2): Variables and Environments, Aliases, Permissions]] (University of Delaware) | |
| * [[http://www.udel.edu/it/research/files/cluster/workshop/regex.pdf|Regular Expressions]] (University of Delaware) - [[Additional note]] | |
| * [[http://www.hpc.udel.edu/presentations/shell_scripting_pt1|Introduction to Shell Scripting (Part 1)]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/shell_scripting_pt1/shell_scripting_pt1.pdf|PDF]]] | |
| * [[http://www.hpc.udel.edu/presentations/shell_scripting_pt2|Introduction to Shell Scripting (Part 2)]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/shell_scripting_pt2/shell_scripting_pt2.pdf|PDF]]] | |
| * [[http://www.hpc.udel.edu/presentations/valet|Modular Environment Management with VALET]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/valet/valet.pdf|PDF]]] | |
| * [[http://www.hpc.udel.edu/presentations/gridengine_intro|Introduction to Grid Engine]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/gridengine_intro/gridengine_intro.pdf|PDF]]] | |
| * [[http://www.hpc.udel.edu/presentations/matlab_batch_mcr/|Matlab: Batch Script and Compiled Array Job]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/matlab_batch_mcr/matlab_batch_mcr.pdf|PDF]]] | |
| * [[http://www.udel.edu/it/research/files/cluster/workshop/Python_Part1.pdf|Python Programming (Part 1)]] (University of Delaware) | |
| * [[http://www.udel.edu/it/research/files/cluster/workshop/Python_Part2.pdf|Python Programming (Part 2)]] (University of Delaware) | |
| * [[http://www.udel.edu/it/research/files/cluster/workshop/python_packages_20115.pdf|Python Packages - matplotlib]] (University of Delaware) - Example files: [[http://www.udel.edu/it/research/files/cluster/workshop/sine_plot.py|sine_plot.py]], [[http://www.udel.edu/it/research/files/cluster/workshop/fit_test1.py|fit_test1.py]], [[http://www.udel.edu/it/research/files/cluster/workshop/fit_test2.py|fit_test2.py]] | |
| * [[http://www.hpc.udel.edu/presentations/making_most_of_farber/|Making the Most of Farber: Storage and Standby]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/making_most_of_farber/making_most_of_farber.pdf|PDF]]] | |
| * [[http://www.hpc.udel.edu/presentations/mills-spillover/|Mills: Job Scheduling Change (Spillover Queue)]] | |
| * [[http://www.udel.edu/it/research/files/cluster/workshop/Compilers.pdf|Compilers: On UD HPC Community Clusters]] (University of Delaware) | |
| * [[http://www.udel.edu/it/research/files/cluster/workshop/MATLAB_Compiler.pdf|Matlab Compiler: On UD HPC Community Clusters]] (University of Delaware) | |
| * [[http://www.hpc.udel.edu/presentations/software-dev-part1/|Unix Software Development Basics: Project Structure and Build Management with Make]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/software-dev-part1/software-dev-part1.pdf|PDF]]] | |
| * [[http://www.hpc.udel.edu/presentations/software-dev-part2/|Unix Software Development Basics: Autotools and Cmake]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/software-dev-part2/software-dev-part2.pdf|PDF]]] | |
| * [[http://www.udel.edu/it/research/files/cluster/workshop/Building_and_Installing_Software.pdf|Building and Installing Software: On UD HPC Community Clusters]] (University of Delaware) | |
| * [[http://www.udel.edu/it/research/files/cluster/workshop/Revision_Control_and_GIT.pdf|Revision Control and Git]] (University of Delaware) | |
| * [[http://www.hpc.udel.edu/presentations/software_management/|Software Management with VALET]] (University of Delaware) [as a [[http://www.hpc.udel.edu/presentations/software_management/software_management.pdf|PDF]]] | |
| |
| HPC presentations at the University of Delaware: | |
| |
| * [[http://www.udel.edu/it/research/files/cluster/workshop/hpc_JFB_Apr2015.pdf|Coupled Regional Weather Modeling Using UD HPC Resources]] (University of Delaware, Joseph Brodie) | |
| * [[http://www.udel.edu/it/research/files/cluster/workshop/hpc_Buxton_Apr2015.pdf|WRF-ARW on Farber]] (University of Delaware, Carly Buxton) | |
| * [[http://www.udel.edu/it/research/files/cluster/workshop/hpc_hanson_Apr2015.pdf|History of CESM and getting it to work on Mills]] (University of Delaware, Brian Hanson) | |