{"id":108,"date":"2018-09-03T14:40:26","date_gmt":"2018-09-03T13:40:26","guid":{"rendered":"http:\/\/ri.itservices.manchester.ac.uk\/csf3\/?page_id=108"},"modified":"2025-05-22T15:04:14","modified_gmt":"2025-05-22T14:04:14","slug":"aspera","status":"publish","type":"page","link":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/software\/applications\/aspera\/","title":{"rendered":"Aspera"},"content":{"rendered":"<h2>Overview<\/h2>\n<p><a href=\"https:\/\/asperasoft.com\/software\/client-options\/desktop-client\/\">Aspera<\/a> downloader is a program to download datasets from various data providers, for example the <a href=\"https:\/\/support.asperasoft.com\/hc\/en-us\/articles\/216125898-Downloading-data-from-NCBI-via-the-command-line\">NCBI<\/a>, that support use of the ascp fast downloader.<\/p>\n<p>Version 3.3.3 is installed on the CSF.<\/p>\n<h2>Restrictions on use<\/h2>\n<p>Details of the licence, restrictions, links to licence docs etc<\/p>\n<h2>Set up procedure<\/h2>\n<p>We now recommend loading modulefiles within your jobscript so that you have a full record of how the job was run. See the example jobscript below for how to do this. Alternatively, you may load modulefiles on the login node and let the job <abbr title=\"add '#$ -V' to your jobscript\">inherit these settings<\/abbr>.<\/p>\n<p>Load one of the following modulefiles:<\/p>\n<pre>\r\nmodule load apps\/singularity\/aspera\/4.2.5\r\nmodule load tools\/bintools\/aspera\/3.3.3\r\n<\/pre>\n<h2>Running the application<\/h2>\n<p>If you have an ssh cert \/ key file then it should be possible to run ascp in a batch job &#8211; no password will be requested if credentials are supplied in a file. If you do not have a credentials file you may run the command on the login node.<\/p>\n<h3>Serial batch job submission<\/h3>\n<p>Make sure you have the modulefile loaded then create a batch submission script, for example:<\/p>\n<pre class=\"slurm\">\r\n#!\/bin\/bash --login\r\n#SBATCH -p serial\r\n#SBATCH -t 1-0       # A limit to 1 day (of a maximum of 7 days).\r\n\r\nmodule purge\r\nmodule load tools\/bintools\/aspera\/3.3.3\r\n\r\n# Optional: Provide path to our own KEYFILE for out data provider.\r\n#           If NOT done, the default asperaweb_id_dsa.openssh will be used.\r\n#           Using a keyfile will prevent ascp asking for a password - so\r\n#           you <strong>must<\/strong> use a keyfile when running as a batch job!\r\n\r\nKEYFILE=~\/path\/to\/keyfile.ssh\r\n\r\nascp -i $KEYFILE -QT -L- -l 1000M &#101;&#x67;a&#x2d;b&#111;&#x78;&#45;&#x38;0&#48;&#x40;&#102;&#x61;s&#x70;&#x2e;&#101;&#x67;a&#x2e;e&#98;&#x69;&#46;&#x61;c&#46;&#x75;&#107;:. .\r\n                                   #\r\n                                   # Change the remote username and server address\r\n                                   # as required by your data provider\r\n<\/pre>\n<pre class=\"sge\">#!\/bin\/bash --login\r\n#$ -cwd               # Job will run from the current directory\r\n                      # NO '#$ -V line' - we load modulefiles in the jobscript\r\n\r\nmodule load tools\/bintools\/aspera\/3.3.3\r\n\r\n# Optional: Provide path to our own KEYFILE for out data provider.\r\n#           If NOT done, the default asperaweb_id_dsa.openssh will be used.\r\n#           Using a keyfile will prevent ascp asking for a password - so\r\n#           you <strong>must<\/strong> use a keyfile when running as a batch job!\r\n\r\nKEYFILE=~\/path\/to\/keyfile.ssh\r\n\r\nascp -i $KEYFILE -QT -L- -l 1000M &#101;&#103;&#x61;&#x2d;&#98;&#111;&#x78;&#x2d;&#56;&#48;&#x30;&#x40;&#102;&#97;&#x73;&#x70;&#46;&#101;&#x67;&#x61;&#46;&#101;&#x62;&#x69;&#46;&#97;&#x63;&#x2e;&#117;&#107;:. .\r\n                                   #\r\n                                   # Change the remote username and server address\r\n                                   # as required by your data provider\r\n<\/pre>\n<p>Submit the jobscript using:<\/p>\n<pre class=\"slurm\">sbatch <em>scriptname<\/em><\/pre>\n<pre class=\"sge\">qsub <em>scriptname<\/em><\/pre>\n<p>where <em>scriptname<\/em> is the name of your jobscript.<\/p>\n<h2>Further info<\/h2>\n<ul>\n<li><a href=\"https:\/\/asperasoft.com\/software\/client-options\/desktop-client\/\">Aspera website<\/a><\/li>\n<li><a href=\"https:\/\/support.asperasoft.com\/hc\/en-us\/articles\/216125898-Downloading-data-from-NCBI-via-the-command-line\">NCBI website<\/a><\/li>\n<\/ul>\n<h2>Updates<\/h2>\n<p>None.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Overview Aspera downloader is a program to download datasets from various data providers, for example the NCBI, that support use of the ascp fast downloader. Version 3.3.3 is installed on the CSF. Restrictions on use Details of the licence, restrictions, links to licence docs etc Set up procedure We now recommend loading modulefiles within your jobscript so that you have a full record of how the job was run. See the example jobscript below for.. <a href=\"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/software\/applications\/aspera\/\">Read more &raquo;<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"parent":86,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-108","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/108","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/comments?post=108"}],"version-history":[{"count":12,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/108\/revisions"}],"predecessor-version":[{"id":10058,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/108\/revisions\/10058"}],"up":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/86"}],"wp:attachment":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/media?parent=108"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}