Slide Navigation






[[ Slide navigation:

Forwards:right arrow, space-bar or enter key
Reverse:left arrow

]]    


The Computational Shared Facility Update
2

 

Introductions

The Computational Shared Facility: 2012 December Update


Simon Hood, Research Infrastructure (CSF Service Owner)

simon.hood@manchester.ac.uk


The Computational Shared Facility Update
3

 

Contribs, OS and Hardware Update

CSF Update: Contributions, OS and Hardware


The Computational Shared Facility Update
4

 

Contributions

University contrib.90kUniversity
Chris Taylor20kImag., Gen. and Prot.
Mike Sutcliffe70kCEAS
Ian Hillier15kChemistry
RGF42kUniversity
Richard Bryce22k (+ 8k)Pharmacy
School contribution299kMACE
Various + school contrib.120kCEAS
Simon Lovell/Simon Whelan15kBioinf. (FLS)
Jane Worthington15kTranslational Med.
Nick Higham54kMaths
Stephen Welbourne15kPsychology
Neil Burton15kChemistry
Paul Popelier14k (+ 15k)Chemistry
Richard Henchman8kChemistry
Matthias Heil13kMaths
Paul Bowyer(30k)Uni Hosp of Sth Man
Faculty contrib(15k)MHS
School/faculty contrib.58k (+ 6k)FLS
Total:959k


The Computational Shared Facility Update
5

 

Compute Hardware Update

What hardware do we have?

Compute: CPU cores
  • HTC: 1332 (+ 252)
  • HPC: 2144 cores (all IB-connected)
Nvidia (GP)GPUs
  • 16 with Infiniband fast interconnect on hosts
  • 7 without
Very High Memory Node
  • 12 cores, 0.5 TB RAM


The Computational Shared Facility Update
6

 

OS Upgrade

OS Upgrade in August to Scientific Linux 6.2


The Computational Shared Facility Update
7

 

New CPU Architectures

Intel Sandy Bridge
  • Soon: 26 SB compute nodes (26 * 12 cores)
  • -l sandybridge (or similar)
AMD Bulldozer
  • 22 Bulldozer nodes (22 * 64 cores, all IB-connected)
  • Code Saturne: 2 * speed, 4 * bang-for-buck vs. old AMD
  • Must use optimised executables:
    • compile with Open64 (or PGI? Not GCC or Intel);
    • link to ACML;
    • vendor-supplied binaries rarely optimised for Bulldozer.


The Computational Shared Facility Update
8

 

Isilon, the CSF and the RDN

Isilon, the CSF and the Research Data Network


The Computational Shared Facility Update
9

 

Isilon

Isilon is the IT Services research data storage facility


The Computational Shared Facility Update
10

 

Isilon and the CSF

A Compute Resource and Data Storage Package


The Computational Shared Facility Update
11

 

Research Data Network

Dedicated 10Gb Backbone on Campus


The Computational Shared Facility Update
12

 

Extras

Extras


The Computational Shared Facility Update
13

 

SSH Gateway

Facilitates off-campus SSH access (without VPN)

Easiest off-campus access for Linux users:
  • Current VPN difficult(!) to use with Linux
  • SSH "hop" instead
In production:
  • Uses central ITS credentials
  • Email for account


The Computational Shared Facility Update
14

 

Virtual Desktop

Off-campus GUI-based access to the CSF

  1. Offers virtual (GNOME) desktop for (primarily) CSF users.
  2. Will be accessible on- and off-campus.
  3. Stateful.
  4. NX-based — heavy compression, works fine on "economy" ISP connections.
  5. Requires NX client (free download for Linux, Mac, MS Windows)
  6. In testing (weeks)


The Computational Shared Facility Update
15

 

Dashboard

Dashboard


The Computational Shared Facility Update
16

 

Policies

Policies


The Computational Shared Facility Update
17

 

Small Contributions

What is the minimum contribution?


The Computational Shared Facility Update
18

 

Scratch Space

Scratch: not a permanent home for files! Quotas???

Agreed policy:
  1. Files greater than three months old may be deleted without notice.
  2. Usually give an email warning — not guaranteed.
  3. Changing the date-stamp of files is permitted.
High risk:
  • Scratch is not backed up; not snapped; minimal resilience.


The Computational Shared Facility Update
19

 

Scratch Quotas

Quotas???
  • One user to fill scratch (or individual OST) over the weekend. . .
  • Millions of (small) files degrades performance and make it difficult to determine culprits
  • Limit capacity and number of files?


The Computational Shared Facility Update
20

 

Storage Options?

Future Storage on the CSF

Storage Options
  • Scratch (Lustre)
  • Home/Isilon
Isilon
  • Buy extra home space — 1.5k per TB for five years (tbc)
    • Un-replicated 750
  • Possible: some Isilon usage will be free at the point of use
    • ISSC end Jan 2013


The Computational Shared Facility Update
21

 

Finale

Finale

Next procurement deadline: 2013 January 31
  • Three contribs so far
  • EPSRC Small Equipment bids?
  • Please let me know as soon as possible!
These slides:


Page Contents:


Contribs, OS and Hardware Update


Isilon and the CSF; research data network


Extras


Policies


Finale

[raiser] [escape] [lower]

Contents: