{"id":2238,"date":"2019-02-08T16:11:05","date_gmt":"2019-02-08T16:11:05","guid":{"rendered":"http:\/\/ri.itservices.manchester.ac.uk\/csf3\/?page_id=2238"},"modified":"2025-05-30T11:43:43","modified_gmt":"2025-05-30T10:43:43","slug":"quota","status":"publish","type":"page","link":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/filesystems\/quota\/","title":{"rendered":"Storage quotas and usage"},"content":{"rendered":"

To ensure fair-usage of storage, the home<\/em> directory storage and any additional Research Data Storage<\/em> (RDS) areas have quotas applied to them. The following sections show how to check the quota of the areas of storage you have access to and how to measure your usage of the storage.<\/p>\n

We generally ask users to keep their home<\/em> storage to 25GB or less. RDS storage areas have their own (larger) quota arranged with the owner of the storage. There are no quotas on scratch<\/em> but an automatic scratch clean-up policy is enforced to delete old scratch files.<\/p>\n

Home Directories<\/h2>\n

Home directories are located on the Isilon storage platform and therefore have quotas applied to them.<\/p>\n

Group Storage Quota and Usage<\/h3>\n

You home directory<\/em> (folder) is itself in a folder associated with your research group. The group area has a storage quota<\/em> applied to it – the overall usage is restricted, usually to a total of about 0.5TB. We request that users try not to use more than 25GB each.<\/p>\n

You can find out the overall quota<\/em> and usage<\/em> for your group by running the following command:<\/p>\n

\r\ndf -h $HOME\r\n\r\nFilesystem                                     Size  Used Avail Use%<\/strong> Mounted on\r\nnas.isilonr.manchester.ac.uk:\/ifs\/nas\/path...  4.0T  2.5T  1.6T  63%<\/strong> \/mnt\/iusers01<\/em>\r\n     #                                           #                          #\r\n     #                                           #                          #\r\n     #                                           # The overall size:  4TB   #\r\n     # You can ignore the Filesystem<\/em> name        # Storage used:    2.5TB   # You can ignore the\r\n                                                 # Still available: 1.6TB   # Mounted on<\/em> name\r\n                                                 # Storage is 63% full\r\n<\/pre>\n
Remember, this is the overall usage and quota for your group’s storage area used for home directories. If you use too much storage you will fill your group’s area, preventing you and your colleagues from working!<\/p>\n
Your total usage<\/h3>\n
To measure your own home directory usage please submit the following batch job. We use a batch job because running the command on the login node can slow down the login node for all other users. Measuring your usage can also take some time to complete so running it in batch will allow you to carry on working (or you can log off and collect the result later).<\/p>\n
\r\n# Batch command run on the login node to measure your home directory usage:\r\nsbatch -p serial -t 15 -J home-dir-usage -o %x.o%j --wrap=\"du -schx ~\"\r\n<\/pre>\n
The total storage usage will be reported in a plain text file (in your home directory) named home-dir-usage.o12345<\/em><\/code> where 12345<\/em><\/code> will be a job-id number unique to your job. <\/p>\n
Scratch<\/h2>\n
The scratch<\/em> area ~\/scratch<\/code> is a different filesystem (different physical storage) to your home directory. There is no quota applied to this directory but you are expected to delete unwanted \/ temporary files after jobs have completed to ensure you don’t use excessive amounts of storage.<\/p>\n
The system can also delete files older than 3-months to free up space!<\/strong> (please see the scratch cleanup policy<\/a> for more information)<\/p>\n
Your total usage<\/h3>\n
To measure your own scratch directory usage please submit the following batch job. We use a batch job because running the command on the login node can slow down the login node for all other users. Measuring your usage can also take some time to complete so running it in batch will allow you to carry on working (or you can log off and collect the result later).<\/p>\n
\r\nsbatch -p serial -t 15 -J scratch-dir-usage -o %x.o%j --wrap=\"du -schx \/scratch\/$USER\"\r\n<\/pre>\n
The total storage usage will be reported in a plain text file (in your home directory) named scratch-dir-usage.o12345<\/em><\/code> where 12345<\/em><\/code> will be a job-id number unique to your job. <\/p>\n
Additional RDS areas<\/h2>\n
If your group has access to additional Research Data Storage<\/em>, usually accessible via a shortcut in your home directory named ~\/data<\/code> (or ~\/rds<\/code>) then you can check the group’s overall quota and your usage using similar commands to those used for the home<\/em> directory:<\/p>\n
\r\n# Overall quota and usage stats for additional RDS area\r\ndf -h ~\/rds<\/em>\/\r\n        #\r\n        # Use the name of your shortcut to your RDS area\r\n\r\n# Your total usage in the additional RDS area\r\nsbatch -p serial -t 15 -J rds-dir-usage -o %x.o%j --wrap=\"du -schx ~\/rds<\/em>\/\"\r\n<\/pre>\n","protected":false},"excerpt":{"rendered":"
To ensure fair-usage of storage, the home directory storage and any additional Research Data Storage (RDS) areas have quotas applied to them. The following sections show how to check the quota of the areas of storage you have access to and how to measure your usage of the storage. We generally ask users to keep their home storage to 25GB or less. RDS storage areas have their own (larger) quota arranged with the owner of.. Read more »<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"parent":94,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-2238","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/2238","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/comments?post=2238"}],"version-history":[{"count":20,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/2238\/revisions"}],"predecessor-version":[{"id":10225,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/2238\/revisions\/10225"}],"up":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/pages\/94"}],"wp:attachment":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf3\/wp-json\/wp\/v2\/media?parent=2238"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}