| Both sides previous revision Previous revision Next revision | Previous revision |
| abstract:darwin:transfer [2024-04-08 16:53] – [Common clients for file transfer] anita | abstract:darwin:transfer [2024-04-08 17:01] (current) – [Common clients for file transfer] anita |
|---|
| | **scp**| Recommended for batch script use. | | | **scp**| Recommended for batch script use. | |
| | **rsync**| Most appropriate for synchronizing the file directories of two systems when only a small fraction \\ of the files have been changed since the last synchronization. | | | **rsync**| Most appropriate for synchronizing the file directories of two systems when only a small fraction \\ of the files have been changed since the last synchronization. | |
| | **Globus**| [[https://www.globusonline.org/|Globus]] command line on Linux and web browser too, and is recommended for 'fire and forget' high-performance data transfers between systems within and across organizations. See [[software:globus:globus|Globus]] for more details.| | | **Globus**| [[https://www.globusonline.org/|Globus]] web browser based and recommended for 'fire and forget' high-performance data transfers between systems within and across organizations.\\ See [[software:globus:globus|Globus]] for more details.| |
| | **Rclone**| [[https://rclone.org/|Rclone]] is a command line program to sync files and directories to and from popular cloud storage services. | | | **Rclone**| [[https://rclone.org/|Rclone]] is a command line program to sync files and directories to and from popular cloud storage services. | |
| |
| | [[http://filezilla-project.org/download.php?type=client|filezilla]] | Windows, Mac OS X, UNIX, Linux | | | [[http://filezilla-project.org/download.php?type=client|filezilla]] | Windows, Mac OS X, UNIX, Linux | |
| | [[http://cyberduck.ch/|cyberduck]] | Windows, Mac OS X (command line version for Linux) | | | [[http://cyberduck.ch/|cyberduck]] | Windows, Mac OS X (command line version for Linux) | |
| | [[https://www.globusonline.org/|Globus]] | Web browser (command line version for Linux) See [[software:globus:globus|Globus]] for more details.| | | [[https://www.globusonline.org/|Globus]] | Web browser. See [[software:globus:globus|Globus]] for more details.| |
| |
| <note warning>For **Windows** clients editing files on Windows desktops and then transferring them back to the cluster, you may find that your file becomes "corrupt" during file transfer process. The symptoms are very subtle because the file appears to be okay, but in fact contains ''CRLF'' line terminators. This causes problems when reading the file on a Linux cluster and generates very strange errors. Some examples might be a file used for submitting a batch job such as ''submit.qs'' and one you have used before and know is correct, will no longer work. Or an input file used for ABAQUS like ''tissue.inp'' which has worked many times before produces an error like ''Abaqus Error: Command line option "input" must have a value.''. | <note warning>For **Windows** clients editing files on Windows desktops and then transferring them back to the cluster, you may find that your file becomes "corrupt" during file transfer process. The symptoms are very subtle because the file appears to be okay, but in fact contains ''CRLF'' line terminators. This causes problems when reading the file on a Linux cluster and generates very strange errors. Some examples might be a file used for submitting a batch job such as ''submit.qs'' and one you have used before and know is correct, will no longer work. Or an input file used for ABAQUS like ''tissue.inp'' which has worked many times before produces an error like ''Abaqus Error: Command line option "input" must have a value.''. |