This is a computation condo HPC system, supplying a variety of hardware, bespoke to our researchers’ needs. Condos are built and offered to PIs based on their needs of budget, hardware, and compute use cases. Ganymede2 has advanced queueing support as well as support for both GPU and CPU-only nodes.
Compute System Specs
Because of the diversity of condos in Ganymede2, there isn’t a unform definition of compute. Moreover, this is a growing cluster and as and when a buy-in happens, we recommend the latest-at-that-point hardware to be installed. With this progression, we are now at 90 CPU Nodes, 22 GPU Nodes with 106 GPUs.
Even though Ganymede2 assets are primarily owned by private researchers, the system has what are called “preempt” queues, which allow job submission from all Ganymede2 users. These preempt jobs (named cpu-preempt and gpu-preeempt) are heavily de-prioritized to the actual queue owner, so any workloads submitted to these queues should be seen as volatile and should heavily utilize checkpointing. When a preempt job is preempted, that job is killed immediately and forcefully. If data isn’t being constantly saved to an output file, data loss should be expected.
Ganymede2, unlike its predecessor, allows multiple jobs per node. Nodes can be “mixed”state, which indicates that node is currently processing multiple jobs at once. GPU nodes with multiple GPUs can have individual GPUs queued up to different jobs, or in some cases each GPU can run multiple jobs at the same time.
The following partitions are available to all users:
| Queue Name | Number of nodes | Cores/Threads (CPU Architecture) | Memory | Time Limit ([d-]hh:mm:ss) | GPUs? | Use Case |
| dev | 2 | 64/128 (Ice Lake) | 256GB | 2:00:00 | No | Code debugging, job submission testing |
| normal | 4 | 64/128 (Ice Lake) | 256GB | 2-00:00:00 | No | Normal code runs, CPU only |
| cpu-preempt | 8 | VARIOUS | VARIOUS | 7-00:00:00 | No | Volatile CPU job submission |
| gpu-preempt | 6 | VARIOUS | VARIOUS | 7-00:00:00 | Yes, VARIOUS types | Volatile GPU job submission |