Distributing jobs for high-performance computing (HPC) clusters (e.g., via Slurm)4 months ago
Introduction | Standard setup on HPC cluster | Example | Limitations | Array jobs | Converting runSimulation() workflow to one for runArraySimulation() | Expand the standard simulation design object for each array ID | Construct and record proper random seeds | Extract array ID information from the .slurm script | Organize information for runArraySimulation() | Putting it all together | Post-evaluation: Combine the files | Array jobs and multicore computing simultaneously | Extra information (FAQs) | Helpful Slurm commands | My HPC cluster excution time is limited and terminates before the simulation is complete | Uploading array jobs related to previous array submissions | Create new conditions for missing replications, and use rbindDesign() | Submit the new job, evaluating only the new conditions
SimDesign 2.25.4Phil ChalmersHPC-computing.Rmd