ACE

Overview

ACE+ is a suite of tools for Computational Fluid Dynamics simulation.

Restrictions on use

This software is licensed to the School of MACE. Users from that school who wish to make use of the software need to be added to the ace unix group. Please email its-ri-team@manchester.ac.uk to request access.

Set up procedure

You must add the following commands to your .bashrc file:

module load apps/binapps/ace/2010.0
module load compilers/intel/fortran/11.1.064

Running the application

All ACE+ jobs must be run in batch.

Serial batch job submission

Awaiting full example. Write a script similar to the parallel example below, but remove the

#$ -pe hp-mpi-smp.pe 24

line (a jobscript without a pe line is a serial jobscript) and make sure you tell the application it only has one core available to it.

Parallel batch job submission

• There are only two parallel environments on the CSF which can handle ACE jobs correctly:

  hp-mpi-smp.pe

  and

  hp-mpi-12.pe

  . You must submit to one of these, failure to do so could lead problems for your job and the system.

• Example submission script:

#!/bin/bash
### SGE Job Stuff
### Set the current/submission directory as the working directory
#$ -cwd
### Inherit environment from the login node
#$ -V
### Submit to the hp-mpi-smp.pe environment and request 24 cores.
#$ -pe hp-mpi-smp.pe 24
#$ -S /bin/bash

dtf_decompose -z -file_out firsttrack_no_preheat.DTF -dmp MASTER_firsttrack_no_preheat.DTF 1 24

CFD-SOLVER -model firsttrack_no_preheat.DTF -num=$NSLOTS -hosts=machinefile.$JOB_ID -sim=1 -nodecomp

• Note 1: -num=$NSLOTS ensures that the number of cores requested (pe line) and the number used by the applications match.
• Note 2: -hosts=machinefile.$JOB_ID ensures that the HPI-MPI environment is correctly configured.

Further info

• The ESI CFD-ACE+ website
• A PDF user manual is available on the CSF. The manual can be viewed using evince:

evince  $ESI_HOME/2010.0/ACE_SOLVER/docs/CFD-ACE_V2010.0_User_Manual.pdf