{"id":357,"date":"2013-04-26T12:50:05","date_gmt":"2013-04-26T12:50:05","guid":{"rendered":"http:\/\/ri.itservices.manchester.ac.uk\/csf-apps\/?page_id=357"},"modified":"2016-11-25T12:49:41","modified_gmt":"2016-11-25T12:49:41","slug":"remotex","status":"publish","type":"page","link":"https:\/\/ri.itservices.manchester.ac.uk\/csf-apps\/software\/applications\/paraview\/remotex\/","title":{"rendered":"Running ParaView Entirely on the CSF (remote X)"},"content":{"rendered":"<h2>Overview<\/h2>\n<p>This page describes how to run ParaView entirely on the CSF over a remote X connection. This is <strong>not<\/strong> the preferred method of running ParaView. However, if you are unable to install the ParaView GUI locally on your own computer then this method will work.<\/p>\n<p>You will need to have an X-server installed on your local computer. See <a href=\"\/csf2\/getting-started-on-the-csf\/using-an-app-with-a-gui-x11-and-qrsh\/\">further information about how to start X-Windows and GUI applications on the CSF<\/a>.<\/p>\n<p>The two methods of running ParaView described here are:<\/p>\n<ol>\n<li>Running only the ParaView GUI interactively &#8211; for small datasets only<\/li>\n<li>Running the ParaView GUI interactively and multiple <code>pvserver<\/code> processes to process and render your datsets in parallel &#8211; for large datasets<\/li>\n<\/ol>\n<p><strong>NOTE:<\/strong> In both cases the <code>paraview<\/code> GUI must <strong>not<\/strong> be run on the login node. You <strong>must<\/strong> run it interactively using <code>qrsh<\/code> as described below.<\/p>\n<h2>Running paraview GUI Interactively (small datasets)<\/h2>\n<p>After loading the ParaView modulefile submit an interactive job to the <code>short<\/code> resource. Note that interactive jobs will not run in the standard 7 day resource.<\/p>\n<pre>\r\nmodule load apps\/gcc\/paraview\/3.14.1\r\nqrsh -V -cwd -b y -l inter -l short paraview\r\n<\/pre>\n<p>The ParaView GUI will start once the system has scheduled your interactive session. <\/p>\n<p>Full details of interactive job limits are given on the <a href=\"\/csf2\/csf-user-documentation\/sge-interactive-jobs-qrsh\">qrsh page<\/a>.<\/p>\n<h2>Running MPI pvserver batch processes and paraview GUI Interactively (large datasets)<\/h2>\n<p>The <code>paraview<\/code> GUI should <strong>not<\/strong> be running at this point.<\/p>\n<p>After loading the ParaView modulefile use a jobscript to launch the <code>pvserver<\/code> MPI processes. The choice of Parallel Environment (PE) depends on whether you want to use InfiniBand-connected nodes for multi-node larger jobs or a single compute node for a smaller jobs. InfiniBand-connected nodes require that the number of cores used is a multiple of 12 or 24 (and a minimum number of cores must be used). Single-node (SMP) jobs can use a smaller number of cores (up to 24).<\/p>\n<h3>pvserver in SMP (single-node smaller jobs)<\/h3>\n<p>Setup paraview by loading the following modulefile on the login node:<\/p>\n<pre>module load apps\/gcc\/paraview\/3.14.1<\/pre>\n<p>(note that the 4.0.1 version cannot be used &#8211; the <code>paraview<\/code> GUI executable is not installed on the CSF in this version. It only has the off screen <code>pvserver<\/code> and <code>pvbatch<\/code> executables).<\/p>\n<p>Create the following jobscript (e.g., naming it pvserver.sh):<\/p>\n<pre>\r\n#!\/bin\/bash\r\n#$ -S \/bin\/bash\r\n#$ -V\r\n#$ -cwd\r\n\r\n#$ -pe smp.pe 4       # Change number of cores (max 24)\r\n\r\n#$ -l short\r\n     #\r\n     # Optional (and max 12 cores must be used above)\r\n\r\n# Ensure the paraview modulefile is loaded\r\n\r\nmpirun -n $NSLOTS pvserver --use-offscreen-rendering\r\n\r\n<\/pre>\n<p>Then submit the above jobscript using<\/p>\n<pre>\r\nqsub <em>jobscript<\/em>\r\n<\/pre>\n<p>where <em>jobscript<\/em> is the name of your file (e.g., <code>pvserver.sh<\/code>)<\/p>\n<h3>pvserver over InfiniBand (larger multi-node jobs)<\/h3>\n<p>Set up paraview by loading the following modulefile on the login node:<\/p>\n<pre>module load apps\/gcc\/paraview\/3.14.1-ib<\/pre>\n<p>(note that the 4.0.1 version cannot be used &#8211; the <code>paraview<\/code> GUI executable is not installed on the CSF in this version. It only has the off screen <code>pvserver<\/code> and <code>pvbatch<\/code> executables).<\/p>\n<p>Create the following jobscript (e.g., naming it pvserver-ib.sh):<\/p>\n<pre>\r\n#$ -S \/bin\/bash\r\n#$ -V\r\n#$ -cwd\r\n#$ -pe orte-24-ib.pe 48\r\n     #\r\n     # Change number of cores, MUST be multiple of 24.\r\n\r\n# Ensure the paraview modulefile is loaded\r\n\r\nmpirun -n $NSLOTS pvserver --use-offscreen-rendering\r\n<\/pre>\n<p>Then submit the above jobscript using<\/p>\n<pre>\r\nqsub <em>jobscript<\/em>\r\n<\/pre>\n<p>where <em>jobscript<\/em> is the name of your file (e.g., <code>pvserver-ib.sh<\/code>)<\/p>\n<h3>Find where the Batch Job is Running<\/h3>\n<p>You must now <strong>wait<\/strong> until the pvserver jobs are running. Use <code>qstat<\/code> to check the job queue. Once the <code>state<\/code> reported by <code>qstat<\/code> has changed from <code>qw<\/code> to <code>r<\/code> you will see something like:<\/p>\n<pre>\r\njob-ID  prior   name     user     state submit\/start at     queue                          slots \r\n------------------------------------------------------------------------------------------------\r\n5724  0.05534 pvserver.q xxxxxxxx r     08\/28\/2012 17:06:57 R410-short.q@<strong>int01<\/strong>.prv.csf       4\r\n<\/pre>\n<p>Make a note of the <strong>queue<\/strong> value, specifically the <strong>hostname<\/strong> after the <strong>@<\/strong>. In this example we see <strong><code>int01<\/code><\/strong> (you don&#8217;t need the .prv.csf&#8230;.). <\/p>\n<p>We now run the <code>paraview<\/code> GUI client and connect it to the rank 0 MPI process running on the backend nodes. To run <code>paraview<\/code> use:<\/p>\n<pre>\r\nqrsh -V -cwd -b y -l inter -l short paraview --server-url=cs:\/\/<strong>int01<\/strong>\r\n   #\r\n   # Change int01 to match the hostname used by your pvserver batch job.\r\n   # You MUST specify -l short for interactive (-l inter) jobs.\r\n<\/pre>\n<p>Once the <code>qrsh<\/code> command has been scheduled to run, the ParaView GUI will appear. The <em>Pipeline Browser<\/em> area should show an icon representing the backend node running the <code>pvserver<\/code> rank 0 process, as show below. This indicates you have successfully connected the <code>paraview<\/code> GUI to the backend <code>pvserver<\/code> processes. Data processing and rendering will be performed in parallel by the backend processes where possible, and only lightweight command-and-control actions will be performed by the GUI process.<\/p>\n<ul style=\"list-style-type: none\">\n<li><a href=\"https:\/\/ri.itservices.manchester.ac.uk\/csf-apps\/wp-content\/uploads\/csfconnected.png\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/ri.itservices.manchester.ac.uk\/csf-apps\/wp-content\/uploads\/csfconnected.png\" alt=\"Paraview Pipeline Browser\" width=\"298\" height=\"74\" class=\"aligncenter size-full wp-image-358\" \/><\/a><\/li>\n<\/ul>\n<p>Further information about the backend processes are available via the <em>Help\/About\/Connection Information<\/em> menu.<\/p>\n<p><a href=\"\/csf-apps\/software\/applications\/paraview\/\">Back to the ParaView page<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Overview This page describes how to run ParaView entirely on the CSF over a remote X connection. This is not the preferred method of running ParaView. However, if you are unable to install the ParaView GUI locally on your own computer then this method will work. You will need to have an X-server installed on your local computer. See further information about how to start X-Windows and GUI applications on the CSF. The two methods.. <a href=\"https:\/\/ri.itservices.manchester.ac.uk\/csf-apps\/software\/applications\/paraview\/remotex\/\">Read more &raquo;<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"parent":343,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-357","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf-apps\/wp-json\/wp\/v2\/pages\/357","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf-apps\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf-apps\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf-apps\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf-apps\/wp-json\/wp\/v2\/comments?post=357"}],"version-history":[{"count":9,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf-apps\/wp-json\/wp\/v2\/pages\/357\/revisions"}],"predecessor-version":[{"id":3450,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf-apps\/wp-json\/wp\/v2\/pages\/357\/revisions\/3450"}],"up":[{"embeddable":true,"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf-apps\/wp-json\/wp\/v2\/pages\/343"}],"wp:attachment":[{"href":"https:\/\/ri.itservices.manchester.ac.uk\/csf-apps\/wp-json\/wp\/v2\/media?parent=357"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}