[Hosting HPC in Azure] Overview

This project is mainly about launching and managing a high-performance computing cluster using CycleCloud 8 in Azure.

The resources in Microsoft Learn are helpful, but I still met some issues. This project is more like a write up about all the details and how-tos.

Design and Architecture

Steps

1. CycleCloud Wizard
   • CycleCloud Concept, UI, and CLI
2. Create HPC Powered by Slurm Scheduler
   • VNet and Subnet and Vnet Peering
   • MySQL Flexible Server
   • Slurm
   • Login node: Load balancer and NAT Gateway
   • Scheduler and Compute Node
3. Installing Software: Lmod and Spack
4. Create NFS Server
   • Using Azure NetApp
   • Using CycleCloud to Launch a NFS
5. Granting User Access

If you still found any issues, you can email me, I might be able to help.