Linux and Mac users can use the command-line to transfer files. While GUI programs do exist, we find the command-line more reliable, if a little more difficult to begin with.<\/p>\n
Open a Terminal<\/em> app on your Linux or Mac desktop to give yourself a command-line. The following commands can then be used. Please note, type them carefully (or cut-n-paste). The commands are sensitive to where the spaces occur and additional characters.<\/p>\n In all of the commands below, replace The Rsync has some nice features for resuming interrupted transfers (no need to transfer everything again) and can be used to keep folders on your PC and the CSF in-sync \u2013 i.e., it can detect which files are new or have changed and only copy those.<\/p>\n Below examples assume that you have opened a terminal at your local machine<\/strong> and that you have changed to the local directory where you want to transfer files to\/from (in MobaXterm specifically you may have to navigate to !!Caution!!:<\/strong> Do NOT put a The If transferring files to your CSF scratch area, you may prefer to apply today’s timestamp to the file, rather than using the original timestamp on the source file. This is so that your file will have the full 3-months in the CSF scratch area before the automatic scratch cleanup policy<\/a> deletes the file! In this case use:<\/p>\n The The commands Remember that all of the above commands are run in a terminal on your laptop\/desktop that IS NOT logged-in to the CSF i.e. the commands are run on your local machine not on the CSF.<\/p>\n Please see the Command-line Tools Linux and Mac users can use the command-line to transfer files. While GUI programs do exist, we find the command-line more reliable, if a little more difficult to begin with. Open a Terminal app on your Linux or Mac desktop to give yourself a command-line. The following commands can then be used. Please note, type them carefully (or cut-n-paste). The commands are sensitive to where the spaces occur and additional characters. In all.. Read more »<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"parent":2767,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-2774","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/2774","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/comments?post=2774"}],"version-history":[{"count":19,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/2774\/revisions"}],"predecessor-version":[{"id":11270,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/2774\/revisions\/11270"}],"up":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/2767"}],"wp:attachment":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/media?parent=2774"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}username<\/em><\/code> with your own IT username.<\/p>\nrsync<\/h2>\n
rsync<\/code> command is used to transfer files securely and efficiently between your PC\/laptop and CSF. No installation is usually needed on Linux or Mac systems (it is there by default). It is also available in Mobaxterm (Windows) when you start a local<\/strong> terminal (instead of the usual remote connection to the CSF).<\/p>\n\/drives\/c\/Users\/your-user-name<\/em><\/code> to find your user’s local files). The commands are run on your PC\/laptop<\/em>, NOT the CSF. Please type them carefully (notice the : between the CSF address and the file or folder names after it).<\/p>\n\n
~<\/code> at the end is short-hand for your CSF home folder<\/em>)\nrsync -avz myinput.dat username<\/em>@csf3.itservices.manchester.ac.uk:~<\/strong><\/pre>\n<\/li>\n
rsync -avz myinput.dat username<\/em>@csf3.itservices.manchester.ac.uk:~\/scratch\/<\/pre>\n<\/li>\n
.<\/code><\/strong> at the end to mean the current folder<\/em> on your PC)\nrsync -avz username<\/em>@csf3.itservices.manchester.ac.uk:~\/myresult.dat .<\/strong><\/pre>\n<\/li>\n
.<\/code><\/strong> at the end to mean the current folder<\/em> on your PC)\nrsync -avz username<\/em>@csf3.itservices.manchester.ac.uk:~\/scratch\/myresult.dat .<\/strong><\/pre>\n<\/li>\n
.<\/code><\/strong> at the end to mean the current folder<\/em> on your PC)\nrsync -avz username<\/em>@csf3.itservices.manchester.ac.uk:~\/scratch\/results_dir .<\/strong><\/pre>\n
\/<\/code> at the end of directory names as it changes the behaviour of rsync and may not do quite what you expect.\n <\/li>\n<\/ul>\n-avz<\/code> flag on the rsync<\/code> command will run it in archive<\/em> mode (it will transfer all files in a folder if a folder name is given instead of a filename and it will preserve the timestamps on files), it will be verbose<\/em> (displaying filenames as it transfers them) and it will compress<\/em> traffic to try to reduce the transfer time (files will be compressed before transfer and decompressed when received). Please check the rsync<\/code> documentation using man rsync<\/code> on your system.<\/p>\nCSF scratch cleanup and timestamps<\/h3>\n
\r\nrsync -rlvz myinput.dat username<\/em>@csf3.itservices.manchester.ac.uk:~\/scratch\/\r\n<\/pre>\n
-rl<\/code> flag replaces the -a<\/code> flag.<\/p>\nscp or sftp<\/h2>\n
scp<\/code> or sftp<\/code> will both transfer files in a similar manner to rsync<\/code>, although rsync offers more options.<\/p>\n\n
:<\/code><\/strong> at the end)\nscp myinput.dat username<\/em>@csf3.itservices.manchester.ac.uk:\r\n<\/pre>\n<\/li>\n
scp myinput.dat username<\/em>@csf3.itservices.manchester.ac.uk:~\/scratch\/<\/pre>\n<\/li>\n
.<\/code><\/strong> at the end to mean the current folder<\/em> on your PC)\nscp username<\/em>@csf3.itservices.manchester.ac.uk:results.out .<\/strong><\/pre>\n<\/li>\n
scp username<\/em>@csf3.itservices.manchester.ac.uk:~\/scratch\/myresults.dat .<\/strong><\/pre>\n<\/li>\n<\/ul>\n
\nE.g. scp -O myinput.dat username@csf3.itservices.manchester.ac.uk:<\/strong>\n<\/div>\nMore information<\/h2>\n
man<\/code> for the command for more help (e.g., man rsync<\/code>). Alternatively have a look at the online docs:<\/p>\n\n