Porting to HPCx
The FAMOUS installation is located under /hpcx/devt/n02/n02-ncas/aosprey/famous (from Simon’s famous_build.tgz and famous_input.tgz).
The job is based on, and should be roughly equivalent to, Simon’s Ruby job xbxxy. These are the changes I made to the job, in order to run on HPCx.
User Information and Target Machine → General details
* Mail-id
* User-id
* Tic Code
User Information and Target Machine → General details
* Machine: login.hpcx.ac.uk
User Information and Target Machine → Target Machine
* Number of processors East-West: 4
* Number of processors North-South: 4
- Note: minimum number of processors on HPCx is 16.
Sub-Model Independent → File & Directory Naming
* FAMOUS_DIR: /hpcx/devt/n02/n02-ncas/aosprey/famous
* FAMOUS_DATA: /hpcx/devt/n02/n02-ncas/aosprey/famous
* -DATA_DIR: /hpcx/devt/n02/n02-ncas/aosprey
- Note: $FAMOUS_DIR and $FAMOUS_DATA are the location of famous mods, ancillary files etc; $DATA_DIR is set to my $DEVTDIR space for output from runs.
Sub-Model Independent → Script Inserts and Modifications
- Turned off all selected mods.
- Added mods for HPCx platform:
* gsm2u406_pum.ll
* script_fix_ibm.mod
* um_archive45_hpcx.mod
- Job submission and time limits
Sub-Model Ind → Job submission, resources and re-submission
* Submission method: ‘llsubmit’ for LoadLeveler
* Job time limit (seconds): 900
Sub-Model Ind → Job submission → NEXT
* Run length for each job: 1 year
Sub-Model Ind → Compilation → Compile options for the model
* Time limit for compilation: 1800
Sub-Model Ind → Compilation → Modifications for the reconfiguration
- Turned off little-endian mods
* port_end_f.mod N
- Added HPCx mods
* abort.mod Y
* ibmf.mod Y
- Turned off little-endian and Linux specific mods
* port_end_f.mod N
* port_end_c.mod N
* linuxf_mpp.mod N
- Added HPCx mods
- Amended the following mods for IBM compiler, by changing flush call to flush_.
* abortfix_ibm.mod
- Replaced with HadCM3 version.
* model_fix.mod
- Added:
Atmosphere → Control → Post processing → Dumping and meaning
* Archive every (restart dumps): 12
* Starting at the (nth): 12
Ocean GCM → Control → Post processing → Dumping & Meaning
* Archive every (restart dumps): 12
* Starting at the (nth): 12