WAVE HPC Technical Specifications

Computational Resources

The main compute resources within the HPC are composed of 12 heterogenous physical nodes of five different types. Condo/Lab nodes are available for use by HPC users but the owners of the nodes have elevated access to resources and jobs running on them may be cancelled and rerun if resources are needed by the lab. HPC resources may only be accessed through the login nodes (via Slurm) or Open OnDemand, which are behind the SA��ʴ�ý VPN and also available on the eduroam WiFi on campus.

WAVE HPC System Architecture Diagram

Computation and Access Nodes

These are the most common nodes an HPC user will interface with and their hardware specifications.

CPU Nodes

Node / Amount	CPU Node (4 Nodes)
Server
Processor
GPU	N/A
CPUs / Node	48
Threads / Node	96
GPUs / Node	0
Memory / Node	512 GB
Storage / Node	1.92 TB

GPU Nodes

Node / Amount	GPU Node (4 Nodes)
Server
Processor
GPU
CPUs / Node	40
Threads / Node	80
GPUs / Node	2
Memory / Node	384 GB
Storage / Node	1.92 TB

Mem Nodes

Node / Amount	Mem Node (2 Nodes)
Server
Processor
GPU	N/A
CPUs / Node	48
Threads / Node	96
GPUs / Node	0
Memory / Node	2 TB
Storage / Node	3.84 TB

AMD Node

Node / Amount	AMD Node (1 Node)
Server
Processor
GPU
CPUs / Node	128
Threads / Node	256
GPUs / Node	8
Memory / Node	256 GB
Storage / Node	960 GB

Hub Node

Node / Amount	Hub Node (1 Node)
Server
Processor
GPU
CPUs / Node	48
Threads / Node	96
GPUs / Node	8
Memory / Node	2.3 TB
Storage / Node	224GB

Login Nodes

Node / Amount	Login Node (2 Nodes)
Server
Processor
GPU
CPUs / Node	32
Threads / Node	64
GPUs / Node	1
Memory / Node	128 GB
Storage / Node	60 GB

Condo Nodes

The Condo nodes belong to various SA��ʴ�ý labs and faculty. While the owners have priority on these nodes, general HPC users are allowed to utilize the resources when available. Keep in mind that other users' jobs may be preempted if resources are needed by the node owner.

Bio Nodes

Node	bio01
Server
Processor
GPU
CPUs	64
Threads	128
GPUs	8
Memory	128 GB
Storage	224 GB

Node	bio02
Server
Processor
GPU
CPUs	64
Threads	128
GPUs	4
Memory	128 GB
Storage	224 GB

Node	bio03
Server
Processor
GPU
CPUs	64
Threads	128
GPUs	8
Memory	128 GB
Storage	224 GB

Node	bio04
Server
Processor
GPU
CPUs	24
Threads	48
GPUs	2
Memory	128 GB
Storage	894 GB

Node	bio05
Server
Processor
GPU
CPUs	24
Threads	48
GPUs	2
Memory	128 GB
Storage	894 GB

Node	bio06
Server
Processor
GPU
CPUs	24
Threads	48
GPUs	2
Memory	120 GB
Storage	894 GB

Dmlab Nodes

Node	dmlab01
Server
Processor
GPU
CPUs	40
Threads	80
GPUs	2
Memory	768 GB
Storage	894 GB

Node	dmlab02
Server
Processor
GPU
CPUs	64
Threads	128
GPUs	8
Memory	1024 GB
Storage	4.4 TB

Node	dmlab03
Server
Processor
GPU
CPUs	72
GPUs	1
Memory	480GB + 96GB GPU Mem
Storage	7.0 TB

Node	dmlab04
Server
Processor
GPU
CPUs	72
GPUs	1
Memory	480GB + 96GB GPU Mem
Storage	7.0 TB

Rgrotjahn Nodes

Node	rgrotjahn01
Server
Processor
GPU	N/A
CPUs	64
Threads	128
GPUs	0
Memory	768 GB
Storage	8 TB

Node	rgrotjahn02
Server
Processor
GPU	N/A
CPUs	64
Threads	128
GPUs	0
Memory	768 GB
Storage	8 TB

Node	rgrotjahn03
Server
Processor
GPU	N/A
CPUs	192
Threads	384
GPUs	0
Memory	1536 GB
Storage	894 GB

Node	rgrotjahn04
Server
Processor
GPU	N/A
CPUs	192
Threads	384
GPUs	0
Memory	1536 GB
Storage	894 GB

Ycho Nodes

Node	ycho201
Server
Processor
GPU	N/A
CPUs	192
Threads	384
GPUs	0
Memory	1536 GB
Storage	894 GB

Node	ycho202
Server
Processor
GPU	N/A
CPUs	192
Threads	384
GPUs	0
Memory	1536 GB
Storage	894 GB

Oignat Nodes

Node	oignat01
Server
Processor
GPU
CPUs	192
Threads	384
GPUs	4
Memory	1536 GB
Storage	894 GB

Yfang Nodes

Node	yfang01
Server
Processor
GPU
CPUs	16
Threads	32
GPUs	4
Memory	112 GB
Storage	7.2TB

NSF Storage and Networking

Storage and Networking hardware for the HPC.

Networking

Media	Speed	Usage
Optical	10-40G	Dual Fiber Network Controllers
IB	100G	Infiniband Switch
RJ-45 Copper	1G	Management Switch

NSF Storage

Equipment	Total Space	Usable Space
	92 TB	63TB
	456 TB HDD (7TB SSD cache)	408 TB HDD (7TB SSD cache)

SA���ʴ�ý