HYPRE<\/a> is a library of high performance preconditioners and solvers featuring multigrid methods for the solution of large, sparse linear systems of equations on massively parallel computers.<\/p>\n There are no restrictions on access to the HYPRE libraries on CSF. The software is released under a MIT and APACHE licenses<\/a>. All usage must adhere to one of these licenses.<\/p>\n We now recommend loading modulefiles within your jobscript so that you have a full record of how the job was run. See the example jobscript below for how to do this. Alternatively, you may load modulefiles on the login node and let the job inherit these settings<\/abbr>.<\/p>\n Load one<\/strong> of the following modulefiles to set up your environment:<\/p>\n You will use the HYPRE installation on CSF3 when compiling your own software or as a dependency when building other downloaded applications. This allows you to add HYPRE functionality to your own apps. There are no executable programs in the installation – you must compile something to generate a HYPRE application.<\/p>\n The modulefiles will set an environment variable named The library is a shared<\/em> library named An example compilation command could be<\/p>\n You must load the HYPRE modulefile before running your HYPRE-capable application.<\/p>\n Please do not run HYPRE-capable applications on the login node. Jobs should be submitted to the compute nodes via batch.<\/p>\n Create a batch submission script (which will load the modulefile in the jobscript), for example:<\/p>\n Submit the jobscript using:<\/p>\n where scriptname<\/em> is the name of your jobscript.<\/p>\n Create a batch submission script (which will load the modulefile in the jobscript), for example:<\/p>\n Submit the jobscript using:<\/p>\n where scriptname<\/em> is the name of your jobscript.<\/p>\n Create a batch submission script (which will load the modulefile in the jobscript), for example:<\/p>\n Submit the jobscript using:<\/p>\n where scriptname<\/em> is the name of your jobscript.<\/p>\n See the HYPRE website for full documentation<\/a>.<\/p>\n None.<\/p>\n","protected":false},"excerpt":{"rendered":" Overview HYPRE is a library of high performance preconditioners and solvers featuring multigrid methods for the solution of large, sparse linear systems of equations on massively parallel computers. Restrictions on use There are no restrictions on access to the HYPRE libraries on CSF. The software is released under a MIT and APACHE licenses. All usage must adhere to one of these licenses. Set up procedure We now recommend loading modulefiles within your jobscript so that.. Read more »<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"parent":140,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-4587","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/4587","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/comments?post=4587"}],"version-history":[{"count":7,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/4587\/revisions"}],"predecessor-version":[{"id":6311,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/4587\/revisions\/6311"}],"up":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/140"}],"wp:attachment":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/media?parent=4587"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}Restrictions on use<\/h2>\n
Set up procedure<\/h2>\n
# All versions have been compiled with the system default GCC 9.3.0 compiler.\r\n\r\nmodule load libs\/gcc\/hypre\/2.25.0-serial # No parallel features enabled\r\nmodule load libs\/gcc\/hypre\/2.25.0-omp # Multi-threaded parallelism (OpenMP)\r\nmodule load libs\/gcc\/hypre\/2.25.0-mpi # Multi-node parallelism (OpenMPI 4.0.1)\r\nmodule load libs\/gcc\/hypre\/2.25.0-cuda # GPU (CUDA 10.1.168), serial CPU\r\n\r\n<\/pre>\n
# All versions have been compiled with the system default GCC 4.8.5 compiler.\r\n# MPI and CUDA modulefiles will be loaded automatically where needed.\r\n\r\nmodule load libs\/gcc\/hypre\/2.18.2-serial # No parallel features enabled\r\nmodule load libs\/gcc\/hypre\/2.18.2-omp # Multi-threaded parallelism (OpenMP)\r\nmodule load libs\/gcc\/hypre\/2.18.2-mpi # Multi-node parallelism (OpenMPI 4.0.1)\r\nmodule load libs\/gcc\/hypre\/2.18.2-cuda # GPU (CUDA 10.1.168), serial CPU\r\nmodule load libs\/gcc\/hypre\/2.18.2-mpi-cuda # GPU (CUDA 10.1.168), MPI (CUDA-aware) CPU\r\n<\/pre>\n
Compiling an HYPRE-capable application<\/h2>\n
${HYPREDIR}<\/code> which can then be used in your compilation process (e.g., in a Makefile or directly on the command-line) to access the header and library files:<\/p>\n\n
gcc -I${HYPREDIR}\/include ....<\/pre>\n<\/li>\ngcc ... -L${HYPREDIR}\/lib -lHYPRE<\/pre>\nlibHYPRE.so<\/code>.<\/li>\n${HYPREDIR}<\/code> rather than $HYPREDIR<\/code>.<\/li>\n<\/ul>\ngcc -I${HYPREDIR}\/include example_hypre.c -o example_hypre -L${HYPREDIR}\/lib -lHYPRE\r\n<\/pre>\nRunning an HYPRE-capable application<\/h2>\n
Serial batch job submission<\/h3>\n
#!\/bin\/bash --login\r\n#$ -cwd # Job will run from the current directory\r\n # NO -V line - we load modulefiles in the jobscript\r\n\r\n# Load the serial (non-MPI) modulefile\r\nmodule load libs\/gcc\/hypre\/2.18.2-serial\r\n\r\n# Run my application I compiled earlier\r\n.\/myhypreapp<\/em> arg1<\/em> ...\r\n<\/pre>\n
qsub scriptname<\/em><\/pre>\n
Parallel OpenMP batch job submission<\/h3>\n
#!\/bin\/bash --login\r\n#$ -cwd # Job will run from the current directory\r\n#$ -pe smp.pe 8 # Number of cores, can be 2--32\r\n # NO -V line - we load modulefiles in the jobscript\r\n\r\n# Load the serial (non-MPI) modulefile\r\nmodule load libs\/gcc\/hypre\/2.18.2-omp\r\n\r\n# Inform the ap how many cores it can use. $NSLOTS is set to the number of cores from above.\r\nexport OMP_NUM_THREADS=$NSLOTS\r\n\r\n# Run my application I compiled earlier\r\n.\/myhypreapp<\/em> arg1<\/em> ...\r\n<\/pre>\n
qsub scriptname<\/em><\/pre>\n
Parallel MPI batch job submission<\/h3>\n
#!\/bin\/bash --login\r\n#$ -cwd # Job will run from the current directory\r\n#$ -pe mpi-24-ib 48 # Number of cores, must be 48 or more in multiples of 24\r\n # NO -V line - we load modulefiles in the jobscript\r\n\r\n# Load the serial (non-MPI) modulefile\r\nmodule load libs\/gcc\/hypre\/2.18.2-mpi\r\n\r\n# Run my application I compiled earlier\r\nmpirun -n $NSLOTS .\/myhypreapp<\/em> arg1<\/em> ...\r\n<\/pre>\n
qsub scriptname<\/em><\/pre>\n
Further info<\/h2>\n
Updates<\/h2>\n