Curl and libcurl

Overview

Curl and libcurl curl is used in command lines or scripts to transfer data. curl is also libcurl, a transfer engine used by other apps.

The system-wide default (no modulefile required) is v7.29.0. Version 7.88.1 is available via a modulefile (see below.)

Restrictions on use

The are no restrictions on accessing this software on the CSF.

Set up procedure

We now recommend loading modulefiles within your jobscript so that you have a full record of how the job was run. See the example jobscript below for how to do this. Alternatively, you may load modulefiles on the login node and let the job inherit these settings.

Load one of the following modulefiles:

module load tools/gcc/curl/7.88.1

Running the application

Downloads should be performed from compute nodes, either in batch or via an interactive session (started with qrsh.)

When compiling other applications that require libcurl, the modulefile will setup environment variables that most compilers will use to find the header and library files.

Serial batch job submission

Create a batch submission script (which will load the modulefile in the jobscript), for example:

#!/bin/bash --login
#$ -cwd             # Job will run from the current directory
                    # NO -V line - we load modulefiles in the jobscript

module load tools/gcc/curl/7.88.2

curl https://remote.address/path

Submit the jobscript using:

qsub scriptname

where scriptname is the name of your jobscript.

Further info

• Curl website

Updates

None.