Current System Configuration

Current config

• 11,960 cores: 299 nodes of 40-core (2 x 20-core sockets) Intel “Cascade Lake” Xeon Gold 6230 CPU @ 2.10GHz
• 954TB scratch running (GPFS 5.0.4-2)
• InfiniBand throughout (Mellanox 100 Gb/sec (4X EDR))
• 2 x Intel Xeon Gold + 2 x Intel Xeon Silver nodes for login and management nodes
• SLURM v22.05.10

The Intel Cascade Lake CPUs provide all of the instruction sets available in the CSF3’s Skylake CPUs (SSE, SSE2, SSE3, S(upplemental)SSE3, SSE4.1, SSE4.2, AVX, AVX2, AVX-512, and AVX512BW,CD,DQ,F,VL) but also the new AVX-512 Vector Neural Network Instructions (VNNI) for more efficient deep-learning inference calculations. If compiling your own source code, please see the Intel Toolchain for a small set of recommended compiler flags to use.