When using High Performance Computing (HPC) platforms, you must request your needed resources when you submit a job. This allows the scheduler to ensure enough resources are available for your job during the whole time it is running, and also know what resources will be free for others to use at the same time. Making inaccurate requests can result in longer queue times, job failures, and wasted resources.
In this session, we explain what 'job scaling' is and discuss job scaling and testing best practices, such as:
- How to run small-scale tests,
- Using and interpreting the results of sacct, and
- Using the results of small-scale tests to predict resource requirements of your full size jobs
For more information on the material covered in this session, visit our Support Documentation site: https://docs.nesi.org.nz/
If you have any questions about this talk or about using the our HPC platform, come to our online Office Hours (https://docs.nesi.org.nz/Getting_Started/Getting_Help/Weekly_Online_Office_Hours/ ) or email Support: [email protected]
Download
0 formats
No download links available.
How to estimate CPU, memory & time needs | NatokHD