{"id":18,"date":"2018-08-28T16:30:55","date_gmt":"2018-08-28T15:30:55","guid":{"rendered":"http:\/\/ri.itservices.manchester.ac.uk\/csf3\/?page_id=18"},"modified":"2026-03-27T11:18:10","modified_gmt":"2026-03-27T11:18:10","slug":"configuration","status":"publish","type":"page","link":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/overview\/configuration\/","title":{"rendered":"Current System Configuration"},"content":{"rendered":"<h2>Summary<\/h2>\n<p>Please note, the CSF3 is in active development with new hardware being added several times a year.<\/p>\n<p>The compute hardware below is available to your jobs via the <a href=\"\/csf3\/batch-slurm\/partitions\/\">CSF3 Slurm Partitions<\/a>.<\/p>\n<p><strong>Total CSF CPU cores: 19,304<\/strong><\/p>\n<ul>\n<li><em>Standard<\/em> AMD nodes total #cores: 12,768 (12,768 in service)<\/li>\n<li><em>Standard<\/em> Intel nodes total #cores: 1,736 (1,736 in service)<\/li>\n<li><em>High memory<\/em> Intel nodes total #cores: 832 (832 in service). <a href=\"\/csf3\/batch-slurm\/high-memory-jobs-slurm\/\">More info&#8230;<\/a><\/li>\n<li><em>HPC Pool<\/em> Intel nodes total #cores: 3,968. <a href=\"\/csf3\/hpc-pool\">More info&#8230;<\/a><\/li>\n<\/ul>\n<p><strong>Total CSF Nvidia GPUs: 200<\/strong><\/p>\n<ul>\n<li>76 x Nvidia A100 (80GB) GPUs (Ampere, 80GB VRAM). <a href=\"\/csf3\/batch-slurm\/gpu-jobs-slurm\/#GPU_Hardware_and_Driver\">More info&#8230;<\/a><\/li>\n<li>8 x Nvidia A100 (40GB) GPUs (Ampere, 40GB VRAM). <a href=\"\/csf3\/batch-slurm\/gpu-jobs-slurm\/#GPU_Hardware_and_Driver\">More info&#8230;<\/a><\/li>\n<li>84 x Nvidia L40S (48GB) GPUs (Ada Lovelace, 48GB VRAM). <a href=\"\/csf3\/batch-slurm\/gpu-jobs-slurm\/#GPU_Hardware_and_Driver\">More info&#8230;<\/a><\/li>\n<li>32 x Nvidia H200 (141 GB) GPUs (Hopper, 141 GB VRAM). <a href=\"\/csf3\/batch-slurm\/gpu-jobs-slurm\/h200\/\">More info&#8230;<\/a>\n<\/ul>\n<p><strong>Total lustre storage (scratch): 1.9PB<\/strong><\/p>\n<p><strong>Login nodes:<\/strong> 3 physical nodes, 96 cores each (2xAMD EPYC 9454 &#8220;Genoa&#8221; 48-Core), 768GB of memory, Nvidia Ampere A2 16GB GPU<\/p>\n<p><strong>Operating System:<\/strong> Redhat-based system<\/p>\n<h2>CPU nodes<\/h2>\n<h3>Standard nodes<\/h3>\n<p>360 Haswell cores: 15 nodes of 2&#215;12-core Intel Xeon E5-2690 v3 @ 2.60GHz + 128GB RAM<\/p>\n<p>1376 Skylake cores: 43 nodes of 2&#215;16-core Intel Xeon Gold 6130 CPU @ 2.10GHz + 192GB RAM + 100Gb\/s (4X EDR) mlx5 Mellanox InfiniBand<\/p>\n<p>12768 AMD Genoa cores: 76 nodes of 2&#215;84-core AMD EPYC Genoa 9634 CPU @ 2.25GHz + 1.5TB RAM + 100GbE network.<\/p>\n<h3>High memory nodes<\/h3>\n<p>96 Skylake cores: 3 nodes of 2&#215;16-core Intel Xeon Gold 6130 CPU @ 2.10GHz + 1.5TB RAM<br \/>\n128 Cascade Lake cores: 4 nodes of 2&#215;16-core Intel Xeon Gold 5218 CPU @ 2.30GHz + 1.5TB RAM<\/p>\n<p>480 Icelake cores: 15 nodes of 2&#215;16-core Intel Xeon Gold 6326 CPU @ 2.90GHz + 2TB RAM<br \/>\n96 Sapphire Rapids cores: 3 nodes of 2&#215;16-core Intel Xeon Gold 6426Y CPU @ 2.50Ghz + 2TB RAM<\/p>\n<p>32 Icelake cores: 1 node of 2&#215;16-core Intel Xeon Gold 6326 CPU @ 2.90GHz CPU + 4TB RAM<\/p>\n<h2>GPU nodes<\/h2>\n<h3>A100 80GB nodes<\/h3>\n<p>19 nodes: 4x Nvidia HGX A100-SXM4-80GB (Ampere) GPUs, 80GB GPU global mem, 6912 CUDA Cores + NVLink. 2&#215;24-core AMD 7413 &#8220;Milan&#8221; CPU @ 2.65GHz + 512GB RAM + 100Gb\/sec (6X HDR) mlx5 Mellanox InfiniBand + 1.6TB Intel Non Volatile memory (NVMe) SSD Controller as \/tmp.<\/p>\n<h3>A100 40GB nodes<\/h3>\n<p>2 nodes: 4x Nvidia HGX A100-SXM4-40GB (Ampere) GPUs 40GB GPU global mem, 6912 CUDA Cores + NVLink + InfiniBand. 2&#215;24-core AMD 7413 &#8220;Milan&#8221; CPU @ 2.65GHz + 512GB RAM + 100Gb\/sec (6X HDR) mlx5 Mellanox InfiniBand + 1.5TB Intel Non Volatile memory (NVMe) SSD Controller as \/tmp.<\/p>\n<h3>L40S nodes<\/h3>\n<p>21 nodes: 4x Nvidia L40S-SXM4-48GB (Ada Lovelace) GPUs 48GB GPU global mem, 18176 CUDA Cores. 2&#215;24-core Intel Xeon(R) Gold 6442Y CPU @ 2.6GHz + 512GB RAM + 28TB SSD as \/tmp.<\/p>\n<h3>H200 nodes<\/h3>\n<p>4 nodes: 8x Nvidia H200-SXM-141GB (Hopper) GPUs 141GB GPU global mem, 16896 CUDA Cores. 2&#215;32-core Inten Xeon(R) Platinum 8562Y+ CPU @ 2.8 Ghz + 1.5 TB RAM + 7.5 TB Non Volatile memory (NVMe) as \/tmp. <\/p>\n<h2>The HPC Pool<\/h2>\n<p>This is a distinct pool of resources with a different access procedure to the CSF. Please consult <a href=\"\/csf3\/hpc-pool\/\">The HPC Pool documentation<\/a> for further information.<\/p>\n<p>3968 Skylake cores: 124 nodes of 2&#215;16-core Intel Xeon Gold 6130 CPU @ 2.10GHz + 512GB RAM + 100Gb\/s (4X EDR) mlx5 Mellanox InfiniBand (4 nodes are no longer in service due to hardware failures. Pool was originally 4,096 cores.)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Summary Please note, the CSF3 is in active development with new hardware being added several times a year. The compute hardware below is available to your jobs via the CSF3 Slurm Partitions. Total CSF CPU cores: 19,304 Standard AMD nodes total #cores: 12,768 (12,768 in service) Standard Intel nodes total #cores: 1,736 (1,736 in service) High memory Intel nodes total #cores: 832 (832 in service). More info&#8230; HPC Pool Intel nodes total #cores: 3,968. More.. <a href=\"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/overview\/configuration\/\">Read more &raquo;<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":8,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-18","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/18","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/comments?post=18"}],"version-history":[{"count":22,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/18\/revisions"}],"predecessor-version":[{"id":12198,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/18\/revisions\/12198"}],"up":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/8"}],"wp:attachment":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/media?parent=18"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}