Subcluster configuration and LIKWID installation
After the basic ClusterCockpit installation you still have to describe the cluster hardware topology and store it as subclusters.
likwid-topology collects the topology and, together with performance metrics (memory bandwidth and FLOPS), the generate-subcluster.pl script converts it into the format required by cluster.json.
1. Install LIKWID
Install LIKWID via git. Set the PREFIX environment variable to the desired installation path before running make.
git clone https://github.com/RRZE-HPC/likwid
cd likwid
PREFIX="/cluster/software/likwid" make
PREFIX="/cluster/software/likwid" make install
Add $PREFIX/bin to PATH afterwards:
export PATH=/cluster/software/likwid/bin:$PATH
Or add it permanently via your shell profile or a module file.
2. Detect subclusters with LIKWID
After installing LIKWID you can automatically detect the hardware topology of each node type with generate-subcluster.pl. The script creates JSON snippets that can be pasted into cluster.json.
Run it on an idle node for every hardware type.
Requirements
- LIKWID binaries (
$PREFIX/bin) must be onPATH - Perl and common system tools need to be installed
export PATH=/cluster/software/likwid/bin:$PATH
./generate-subcluster.pl
Sample output:
{
"name": "<FILL IN>",
"processorType": "AMD EPYC 9254 24-Core Processor ",
"socketsPerNode": 2,
"coresPerSocket": 24,
"threadsPerCore": 1,
"flopRateScalar": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 508
},
"flopRateSimd": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 3171
},
"memoryBandwidth": {
"unit": {
"base": "B/s",
"prefix": "G"
},
"value": 587
},
"nodes": "<FILL IN NODE RANGES>",
"topology": {
"node": [0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47],
"socket": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23],
[24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47]
],
"memoryDomain": [
[0,1,2,3,4,5],
[6,7,8,9,10,11],
[12,13,14,15,16,17],
[18,19,20,21,22,23],
[24,25,26,27,28,29],
[30,31,32,33,34,35],
[36,37,38,39,40,41],
[42,43,44,45,46,47]
],
"core": [
[0],[1],[2],[3],[4],[5],[6],[7],[8],[9],[10],[11],[12],[13],[14],[15],[16],[17],[18],[19],[20],[21],[22],[23],[24],[25],[26],[27],[28],[29],[30],[31],[32],[33],[34],[35],[36],[37],[38],[39],[40],[41],[42],[43],[44],[45],[46],[47]
]
}
}
You still have to fill in the subcluster name and node range (e.g. cpu[001-100]).
Run the script separately for every node type with a different topology (CPU type, memory layout, …). The nodes should be idle so that the measured flopRate and memoryBandwidth values are accurate.
Store each subcluster inside cluster.json under subClusters. After restarting cc-backend they appear in the web UI under Status and Nodes.
For GPU or accelerator nodes add an accelerators key containing their PCI IDs (as shown by nvidia-smi) below core:
"accelerators": [
{
"id": "00000000:26:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H100"
},
...
]
Tip:
Use jq < cluster.json to validate the file after adding the subclusters.
Example configuration
The following cluster.json shows a production-style example configuration with multiple subclusters.
Show contents
{
"name": "elysium",
"metricConfig": [
{
"name": "cpu_load",
"unit": {
"base": "load"
},
"scope": "node",
"aggregation": "avg",
"timestep": 60,
"peak": 48,
"normal": 48,
"caution": 10,
"alert": 1,
"subClusters": [
{ "name": "fatcpu", "peak": 96, "normal": 96, "caution": 10, "alert": 1 },
{ "name": "fatgpu", "peak": 96, "normal": 96, "caution": 10, "alert": 1 },
{ "name": "h200gpu", "peak": 128, "normal": 128, "caution": 10, "alert": 1 },
{ "name": "tcpu", "peak": 192, "normal": 192, "caution": 10, "alert": 1 },
{ "name": "tl40sgpu", "peak": 64, "normal": 64, "caution": 10, "alert": 1 },
{ "name": "th200gpu", "peak": 64, "normal": 64, "caution": 10, "alert": 1 },
{ "name": "tvis", "peak": 128, "normal": 128, "caution": 10, "alert": 1 }
]
},
{
"name": "cpu_user",
"unit": {
"base": "%",
"description": "Percentage of CPU time spent in user mode"
},
"scope": "hwthread",
"aggregation": "avg",
"footprint": "avg",
"timestep": 60,
"peak": 100,
"normal": 70,
"caution": 50,
"alert": 30
},
{
"name": "cpu_load_core",
"unit": {
"base": "load"
},
"scope": "hwthread",
"aggregation": "avg",
"timestep": 60,
"peak": 12,
"normal": 1.1,
"caution": 2,
"alert": 3,
"lowerIsBetter": true
},
{
"name": "mem_used",
"unit": {
"base": "B",
"prefix": "G"
},
"scope": "memoryDomain",
"aggregation": "sum",
"timestep": 60,
"peak": 384,
"normal": 384,
"caution": 384,
"alert": 384,
"subClusters": [
{ "name": "fatcpu", "peak": 2600, "normal": 2304, "caution": 2304, "alert": 2304 },
{ "name": "cpu_abs2", "peak": 900, "normal": 768, "caution": 768, "alert": 768 },
{ "name": "fatgpu", "peak": 1500, "normal": 1152, "caution": 1152, "alert": 1152 },
{ "name": "vis", "peak": 1500, "normal": 1152, "caution": 1152, "alert": 1152 },
{ "name": "h200gpu", "peak": 2700, "normal": 2304, "caution": 2304, "alert": 2304 },
{ "name": "tcpu", "peak": 1800, "normal": 1536, "caution": 1536, "alert": 1536 },
{ "name": "tl40sgpu", "peak": 900, "normal": 768, "caution": 768, "alert": 768 },
{ "name": "th200gpu", "peak": 1800, "normal": 1536, "caution": 1536, "alert": 1536 },
{ "name": "tvis", "peak": 900, "normal": 768, "caution": 768, "alert": 768 }
]
},
{
"name": "mem_bw",
"unit": {
"base": "B/s",
"prefix": "G"
},
"scope": "socket",
"aggregation": "sum",
"timestep": 60,
"peak": 700,
"normal": 591,
"caution": 591,
"alert": 591,
"subClusters": [
{ "name": "fatcpu", "peak": 900, "normal": 778, "caution": 778, "alert": 778 },
{ "name": "fatgpu", "peak": 900, "normal": 779, "caution": 779, "alert": 779 },
{ "name": "h200gpu", "peak": 900, "normal": 790, "caution": 790, "alert": 790 },
{ "name": "tcpu", "peak": 1000, "normal": 892, "caution": 892, "alert": 892 },
{ "name": "th200gpu", "peak": 1000, "normal": 864, "caution": 864, "alert": 864 },
{ "name": "tvis", "peak": 1300, "normal": 1148, "caution": 1148, "alert": 1148 }
]
},
{
"name": "net_bytes_in",
"unit": {
"base": "B/s",
"prefix": "M"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"lowerIsBetter": true,
"peak": 125,
"normal": 10,
"caution": 20,
"alert": 40
},
{
"name": "net_bytes_out",
"unit": {
"base": "B/s",
"prefix": "M"
},
"scope": "node",
"aggregation": "sum",
"lowerIsBetter": true,
"timestep": 60,
"peak": 125,
"normal": 10,
"caution": 20,
"alert": 40
},
{
"name": "net_pkts_in",
"unit": {
"base": "packets/s"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 100,
"caution": 100,
"alert": 100
},
{
"name": "net_pkts_out",
"unit": {
"base": "packets/s"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 100,
"caution": 100,
"alert": 100
},
{
"name": "disk_free",
"unit": { "base": "B", "prefix": "G" },
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 3755,
"normal": 1878,
"caution": 939,
"alert": 376,
"subClusters": [
{ "name": "cpu", "peak": 876, "normal": 876, "caution": 219, "alert": 88 },
{ "name": "cpu_abs2", "peak": 3755, "normal": 3755, "caution": 939, "alert": 376 },
{ "name": "gpu", "peak": 1836, "normal": 1836, "caution": 459, "alert": 184 },
{ "name": "fatcpu", "peak": 1836, "normal": 1836, "caution": 459, "alert": 184 },
{ "name": "fatgpu", "peak": 1836, "normal": 1836, "caution": 459, "alert": 184 },
{ "name": "vis", "peak": 876, "normal": 876, "caution": 219, "alert": 88 }
]
},
{
"name": "io_reads",
"unit": {
"base": "ops/s"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 100,
"caution": 100,
"alert": 100
},
{
"name": "io_writes",
"unit": {
"base": "ops/s"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 100,
"caution": 100,
"alert": 100
},
{
"name": "lustre_open",
"unit": {
"base": "operations"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 50000,
"normal": 25000,
"caution": 40000,
"alert": 45000
},
{
"name": "lustre_close",
"unit": {
"base": "operations"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 50000,
"normal": 25000,
"caution": 40000,
"alert": 45000
},
{
"name": "lustre_statfs",
"unit": {
"base": "operations"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 50,
"caution": 80,
"alert": 90
},
{
"name": "lustre_read_bw",
"unit": {
"base": "B/s",
"prefix": "M"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 60000,
"normal": 60000,
"caution": 60000,
"alert": 60000
},
{
"name": "lustre_write_bw",
"unit": {
"base": "B/s",
"prefix": "M"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 60000,
"normal": 60000,
"caution": 60000,
"alert": 60000
},
{
"name": "nfs4_open",
"unit": {
"base": "operations"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 100,
"caution": 100,
"alert": 100
},
{
"name": "nfs4_close",
"unit": {
"base": "operations"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 100,
"caution": 100,
"alert": 100
},
{
"name": "nfsio_nread",
"unit": {
"base": "B/s",
"prefix": "M"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 100,
"caution": 100,
"alert": 100
},
{
"name": "nfsio_nwrite",
"unit": {
"base": "B/s",
"prefix": "M"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 100,
"caution": 100,
"alert": 100
},
{
"name": "numastats_interleave_hit",
"unit": {
"base": "count/s"
},
"scope": "memoryDomain",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 100,
"caution": 100,
"alert": 100
},
{
"name": "numastats_local_node",
"unit": {
"base": "count/s"
},
"scope": "memoryDomain",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 100,
"caution": 100,
"alert": 100
},
{
"name": "numastats_numa_foreign",
"unit": {
"base": "count/s"
},
"scope": "memoryDomain",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 100,
"caution": 100,
"alert": 100
},
{
"name": "numastats_numa_hit",
"unit": {
"base": "count/s"
},
"scope": "memoryDomain",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 100,
"caution": 100,
"alert": 100
},
{
"name": "numastats_numa_miss",
"unit": {
"base": "count/s"
},
"scope": "memoryDomain",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 100,
"caution": 100,
"alert": 100
},
{
"name": "numastats_other_node",
"unit": {
"base": "count/s"
},
"scope": "memoryDomain",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 100,
"caution": 100,
"alert": 100
},
{
"name": "ib_recv",
"unit": {
"base": "B/s",
"prefix": "M"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 12000,
"normal": 10000,
"caution": 0,
"alert": 0
},
{
"name": "ib_xmit",
"unit": {
"base": "B/s",
"prefix": "M"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 12000,
"normal": 10000,
"caution": 0,
"alert": 0
},
{
"name": "ib_recv_pkts",
"unit": {
"base": "packets/s"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 1100000,
"normal": 800000,
"caution": 0,
"alert": 0
},
{
"name": "ib_xmit_pkts",
"unit": {
"base": "packets/s"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 1100000,
"normal": 800000,
"caution": 0,
"alert": 0
},
{
"name": "nv_compute_processes",
"unit": {
"base": "processes"
},
"scope": "accelerator",
"aggregation": "sum",
"timestep": 60,
"peak": 100,
"normal": 50,
"caution": 80,
"alert": 90,
"subClusters": [
{ "name": "cpu", "remove": true },
{ "name": "cpu_abs2", "remove": true },
{ "name": "fatcpu", "remove": true },
{ "name": "tcpu", "remove": true }
]
},
{
"name": "acc_utilization",
"unit": {
"base": "%",
"description": "GPU Utilization Percentage"
},
"scope": "accelerator",
"aggregation": "avg",
"footprint": "avg",
"timestep": 60,
"peak": 100,
"normal": 90,
"caution": 70,
"alert": 60,
"subClusters": [
{ "name": "cpu", "remove": true },
{ "name": "cpu_abs2", "remove": true },
{ "name": "fatcpu", "remove": true },
{ "name": "tcpu", "remove": true }
]
},
{
"name": "acc_mem_used",
"unit": {
"base": "B",
"prefix": "G"
},
"scope": "accelerator",
"aggregation": "sum",
"timestep": 60,
"peak": 80,
"normal": 24,
"caution": 38,
"alert": 45,
"subClusters": [
{ "name": "cpu", "remove": true },
{ "name": "cpu_abs2", "remove": true },
{ "name": "fatcpu", "remove": true },
{ "name": "tcpu", "remove": true },
{ "name": "gpu", "scope": "accelerator", "aggregation": "sum", "timestep": 60, "peak": 80, "normal": 70, "caution": 71, "alert": 72 },
{ "name": "fatgpu", "scope": "accelerator", "aggregation": "sum", "timestep": 60, "peak": 840, "normal": 638, "caution": 639, "alert": 640 },
{ "name": "vis", "scope": "accelerator", "aggregation": "sum", "timestep": 60, "peak": 48, "normal": 47, "caution": 47, "alert": 48 },
{ "name": "h200gpu", "scope": "accelerator", "aggregation": "sum", "timestep": 60, "peak": 1512, "normal": 1150, "caution": 1151, "alert": 1152 }
]
},
{
"name": "acc_power",
"unit": {
"base": "W"
},
"scope": "accelerator",
"aggregation": "sum",
"timestep": 60,
"energy": "power",
"peak": 300,
"normal": 150,
"caution": 250,
"alert": 280,
"subClusters": [
{ "name": "cpu", "remove": true },
{ "name": "cpu_abs2", "remove": true },
{ "name": "fatcpu", "remove": true },
{ "name": "tcpu", "remove": true },
{ "name": "gpu", "scope": "accelerator", "aggregation": "sum", "energy": "power", "timestep": 60, "peak": 600, "normal": 493, "caution": 494, "alert": 495 },
{ "name": "fatgpu", "scope": "accelerator", "aggregation": "sum", "energy": "power", "timestep": 60, "peak": 6000, "normal": 5580, "caution": 5590, "alert": 5600 },
{ "name": "vis", "scope": "accelerator", "aggregation": "sum", "energy": "power", "timestep": 60, "peak": 400, "normal": 290, "caution": 295, "alert": 300 },
{ "name": "h200gpu", "scope": "accelerator", "aggregation": "sum", "energy": "power", "timestep": 60, "peak": 6000, "normal": 5580, "caution": 5590, "alert": 5600 }
]
},
{
"name": "acc_mem_util",
"unit": {
"base": "%",
"description": "GPU Memory Utilization Percentage"
},
"scope": "accelerator",
"aggregation": "avg",
"timestep": 60,
"peak": 100,
"normal": 80,
"caution": 50,
"alert": 20,
"subClusters": [
{ "name": "cpu", "remove": true },
{ "name": "cpu_abs2", "remove": true },
{ "name": "fatcpu", "remove": true },
{ "name": "tcpu", "remove": true }
]
},
{
"name": "clock",
"unit": {
"base": "MHz"
},
"scope": "hwthread",
"aggregation": "avg",
"timestep": 60,
"peak": 4980,
"normal": 4150,
"caution": 4150,
"alert": 4150,
"subClusters": [
{ "name": "fatcpu", "peak": 4560, "normal": 3800, "caution": 3800, "alert": 3800 },
{ "name": "fatgpu", "peak": 4560, "normal": 3800, "caution": 3800, "alert": 3800 },
{ "name": "h200gpu", "peak": 4500, "normal": 3750, "caution": 3750, "alert": 3750 },
{ "name": "tcpu", "peak": 4440, "normal": 3700, "caution": 3700, "alert": 3700 },
{ "name": "th200gpu", "peak": 5280, "normal": 4400, "caution": 4400, "alert": 4400 },
{ "name": "tl40sgpu", "peak": 5160, "normal": 4300, "caution": 4300, "alert": 4300 },
{ "name": "tvis", "peak": 5160, "normal": 4300, "caution": 4300, "alert": 4300 }
]
},
{
"name": "ipc",
"unit": {
"base": "IPC"
},
"scope": "hwthread",
"aggregation": "avg",
"footprint": "avg",
"timestep": 60,
"peak": 6,
"normal": 6,
"caution": 1,
"alert": 0
},
{
"name": "core_power",
"unit": {
"base": "W"
},
"scope": "hwthread",
"aggregation": "sum",
"energy": "power",
"timestep": 60,
"peak": 480,
"normal": 400,
"caution": 400,
"alert": 400,
"subClusters": [
{ "name": "fatcpu", "peak": 600, "normal": 580, "caution": 580, "alert": 580 },
{ "name": "fatgpu", "peak": 600, "normal": 580, "caution": 580, "alert": 580 },
{ "name": "h200gpu", "peak": 800, "normal": 720, "caution": 720, "alert": 720 },
{ "name": "tcpu", "peak": 800, "normal": 640, "caution": 640, "alert": 640 },
{ "name": "th200gpu", "peak": 480, "normal": 420, "caution": 420, "alert": 420 },
{ "name": "tl40sgpu", "peak": 300, "normal": 300, "caution": 300, "alert": 300 },
{ "name": "tvis", "peak": 600, "normal": 600, "caution": 600, "alert": 600 }
]
},
{
"name": "flops_any",
"unit": {
"base": "FLOPS",
"prefix": "G"
},
"scope": "hwthread",
"aggregation": "sum",
"footprint": "avg",
"timestep": 60,
"peak": 3200,
"normal": 3200,
"caution": 107,
"alert": 54,
"subClusters": [
{ "name": "fatcpu", "peak": 5800, "normal": 5809, "caution": 194, "alert": 97 },
{ "name": "fatgpu", "peak": 5800, "normal": 5796, "caution": 194, "alert": 97 },
{ "name": "h200gpu", "peak": 7600, "normal": 7607, "caution": 254, "alert": 127 },
{ "name": "tcpu", "peak": 22400, "normal": 22393, "caution": 747, "alert": 374 },
{ "name": "th200gpu", "peak": 9000, "normal": 8919, "caution": 298, "alert": 149 },
{ "name": "tl40sgpu", "peak": 7900, "normal": 7860, "caution": 262, "alert": 131 },
{ "name": "tvis", "peak": 16000, "normal": 15758, "caution": 526, "alert": 263 }
]
},
{
"name": "flops_bf16",
"unit": {
"base": "FLOPS",
"prefix": "G"
},
"scope": "hwthread",
"aggregation": "sum",
"footprint": "avg",
"timestep": 60,
"peak": 3000,
"normal": 3000,
"caution": 100,
"alert": 50,
"subClusters": [
{"name": "cpu", "remove": true },
{ "name": "cpu_abs2", "remove": true },
{ "name": "fatcpu", "remove": true },
{ "name": "gpu", "remove": true },
{ "name": "fatgpu", "remove": true },
{ "name": "vis", "remove": true },
{ "name": "h200gpu", "remove": true },
{ "name": "tcpu", "peak": 53800, "normal": 44786, "caution": 1493, "alert": 746 },
{ "name": "tl40sgpu", "peak": 18900, "normal": 15720, "caution": 524, "alert": 262 },
{ "name": "th200gpu", "peak": 21500, "normal": 17838, "caution": 595, "alert": 297 },
{ "name": "tvis", "peak": 37900, "normal": 31516, "caution": 1051, "alert": 525 }
]
},
{
"name": "flops_sp",
"unit": {
"base": "FLOPS",
"prefix": "G"
},
"scope": "hwthread",
"aggregation": "sum",
"footprint": "avg",
"timestep": 60,
"peak": 3000,
"normal": 3000,
"caution": 100,
"alert": 50,
"subClusters": [
{"name": "cpu", "remove": true },
{ "name": "cpu_abs2", "remove": true },
{ "name": "fatcpu", "remove": true },
{ "name": "gpu", "remove": true },
{ "name": "fatgpu", "remove": true },
{ "name": "vis", "remove": true },
{ "name": "h200gpu", "remove": true },
{ "name": "tcpu", "peak": 26900, "normal": 22393, "caution": 747, "alert": 374 },
{ "name": "tl40sgpu", "peak": 9500, "normal": 7860, "caution": 262, "alert": 131 },
{ "name": "th200gpu", "peak": 10800, "normal": 8919, "caution": 298, "alert": 149 },
{ "name": "tvis", "peak": 19000, "normal": 15758, "caution": 526, "alert": 263 }
]
},
{
"name": "flops_dp",
"unit": {
"base": "FLOPS",
"prefix": "G"
},
"scope": "hwthread",
"aggregation": "sum",
"footprint": "avg",
"timestep": 60,
"peak": 3000,
"normal": 3000,
"caution": 100,
"alert": 50,
"subClusters": [
{"name": "cpu", "remove": true },
{ "name": "cpu_abs2", "remove": true },
{ "name": "fatcpu", "remove": true },
{ "name": "gpu", "remove": true },
{ "name": "fatgpu", "remove": true },
{ "name": "vis", "remove": true },
{ "name": "h200gpu", "remove": true },
{ "name": "tcpu", "peak": 13500, "normal": 11197, "caution": 373, "alert": 187 },
{ "name": "tl40sgpu", "peak": 4800, "normal": 3930, "caution": 131, "alert": 66 },
{ "name": "th200gpu", "peak": 5400, "normal": 4460, "caution": 149, "alert": 74 },
{ "name": "tvis", "peak": 9500, "normal": 7879, "caution": 263, "alert": 131 }
]
},
{
"name": "node_total_power",
"unit": {
"base": "W"
},
"scope": "node",
"aggregation": "sum",
"timestep": 60,
"peak": 11400,
"normal": 9500,
"caution": 9500,
"alert": 9500,
"subClusters": [
{ "name": "cpu", "peak": 900, "normal": 750, "caution": 750, "alert": 750 },
{ "name": "cpu_abs2", "peak": 900, "normal": 750, "caution": 750, "alert": 750 },
{ "name": "gpu", "peak": 3600, "normal": 3000, "caution": 3000, "alert": 3000 },
{ "name": "fatcpu", "peak": 2000, "normal": 1600, "caution": 1600, "alert": 1600 },
{ "name": "fatgpu", "peak": 11400, "normal": 9500, "caution": 9500, "alert": 9500 },
{ "name": "vis", "peak": 3300, "normal": 2700, "caution": 2700, "alert": 2700 },
{ "name": "h200gpu", "peak": 11400, "normal": 9500, "caution": 9500, "alert": 9500 },
{ "name": "tcpu", "peak": 2400, "normal": 2000, "caution": 2000, "alert": 2000 },
{ "name": "tl40sgpu", "peak": 4200, "normal": 3500, "caution": 3500, "alert": 3500 },
{ "name": "th200gpu", "peak": 11400, "normal": 9500, "caution": 9500, "alert": 9500 },
{ "name": "tvis", "peak": 3600, "normal": 3000, "caution": 3000, "alert": 3000 }
]
},
{
"name": "job_mem_used",
"unit": { "base": "B", "prefix": "G" },
"scope": "hwthread",
"aggregation": "sum",
"timestep": 60,
"peak": 400,
"normal": 384,
"caution": 384,
"alert": 384,
"subClusters": [
{ "name": "fatcpu", "peak": 2600, "normal": 2304, "caution": 2304, "alert": 2304 },
{ "name": "cpu_abs2", "peak": 900, "normal": 768, "caution": 768, "alert": 768 },
{ "name": "fatgpu", "peak": 1500, "normal": 1152, "caution": 1152, "alert": 1152 },
{ "name": "vis", "peak": 1500, "normal": 1152, "caution": 1152, "alert": 1152 },
{ "name": "h200gpu", "peak": 2700, "normal": 2304, "caution": 2304, "alert": 2304 },
{ "name": "tcpu", "peak": 1800, "normal": 1536, "caution": 1536, "alert": 1536 },
{ "name": "tl40sgpu", "peak": 900, "normal": 768, "caution": 768, "alert": 768 },
{ "name": "th200gpu", "peak": 1800, "normal": 1536, "caution": 1536, "alert": 1536 },
{ "name": "tvis", "peak": 900, "normal": 768, "caution": 768, "alert": 768 }
]
}
],
"subClusters": [
{
"name": "cpu",
"processorType": "AMD EPYC 9254 24-Core Processor",
"socketsPerNode": 2,
"coresPerSocket": 24,
"threadsPerCore": 1,
"flopRateScalar": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 517
},
"flopRateSimd": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 3175
},
"memoryBandwidth": {
"unit": {
"base": "B/s",
"prefix": "G"
},
"value": 591
},
"nodes": "cpu[001-284]",
"topology": {
"node": [0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47],
"socket": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23],
[24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47]
],
"memoryDomain": [
[0,1,2,3,4,5],
[6,7,8,9,10,11],
[12,13,14,15,16,17],
[18,19,20,21,22,23],
[24,25,26,27,28,29],
[30,31,32,33,34,35],
[36,37,38,39,40,41],
[42,43,44,45,46,47]
],
"core": [
[0],[1],[2],[3],[4],[5],[6],[7],[8],[9],[10],[11],[12],[13],[14],[15],[16],[17],[18],[19],[20],[21],[22],[23],[24],[25],[26],[27],[28],[29],[30],[31],[32],[33],[34],[35],[36],[37],[38],[39],[40],[41],[42],[43],[44],[45],[46],[47]
]
}
},
{
"name": "cpu_abs2",
"processorType": "AMD EPYC 9254 24-Core Processor",
"socketsPerNode": 2,
"coresPerSocket": 24,
"threadsPerCore": 1,
"flopRateScalar": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 517
},
"flopRateSimd": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 3175
},
"memoryBandwidth": {
"unit": {
"base": "B/s",
"prefix": "G"
},
"value": 591
},
"nodes": "cpu[285-336]",
"topology": {
"node": [0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47],
"socket": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23],
[24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47]
],
"memoryDomain": [
[0,1,2,3,4,5],
[6,7,8,9,10,11],
[12,13,14,15,16,17],
[18,19,20,21,22,23],
[24,25,26,27,28,29],
[30,31,32,33,34,35],
[36,37,38,39,40,41],
[42,43,44,45,46,47]
],
"core": [
[0],[1],[2],[3],[4],[5],[6],[7],[8],[9],[10],[11],[12],[13],[14],[15],[16],[17],[18],[19],[20],[21],[22],[23],[24],[25],[26],[27],[28],[29],[30] ,[31],[32],[33],[34],[35],[36],[37],[38],[39],[40],[41],[42],[43],[44],[45],[46],[47]
]
}
},
{
"name": "fatcpu",
"processorType": "AMD EPYC 9454 48-Core Processor",
"socketsPerNode": 2,
"coresPerSocket": 48,
"threadsPerCore": 1,
"flopRateScalar": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 972
},
"flopRateSimd": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 5809
},
"memoryBandwidth": {
"unit": {
"base": "B/s",
"prefix": "G"
},
"value": 778
},
"nodes": "fatcpu[001-013]",
"topology": {
"node": [0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95],
"socket": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47],
[48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95]
],
"memoryDomain": [
[0,1,2,3,4,5],
[6,7,8,9,10,11],
[12,13,14,15,16,17],
[18,19,20,21,22,23],
[24,25,26,27,28,29],
[30,31,32,33,34,35],
[36,37,38,39,40,41],
[42,43,44,45,46,47],
[48,49,50,51,52,53],
[54,55,56,57,58,59],
[60,61,62,63,64,65],
[66,67,68,69,70,71],
[72,73,74,75,76,77],
[78,79,80,81,82,83],
[84,85,86,87,88,89],
[90,91,92,93,94,95]
],
"core": [
[0],[1],[2],[3],[4],[5],[6],[7],[8],[9],[10],[11],[12],[13],[14],[15],[16],[17],[18],[19],[20],[21],[22],[23],[24],[25],[26],[27],[28],[29],[30],[31],[32],[33],[34],[35],[36],[37],[38],[39],[40],[41],[42],[43],[44],[45],[46],[47],[48],[49],[50],[51],[52],[53],[54],[55],[56],[57],[58],[59],[60],[61],[62],[63],[64],[65],[66],[67],[68],[69],[70],[71],[72],[73],[74],[75],[76],[77],[78],[79],[80],[81],[82],[83],[84],[85],[86],[87],[88],[89],[90],[91],[92],[93],[94],[95]
]
}
},
{
"name": "gpu",
"processorType": "AMD EPYC 9254 24-Core Processor",
"socketsPerNode": 2,
"coresPerSocket": 24,
"threadsPerCore": 1,
"flopRateScalar": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 508
},
"flopRateSimd": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 3163
},
"memoryBandwidth": {
"unit": {
"base": "B/s",
"prefix": "G"
},
"value": 587
},
"nodes": "gpu[001-020]",
"topology": {
"node": [0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47],
"socket": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23],
[24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47]
],
"memoryDomain": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23],
[24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47]
],
"core": [
[0],[1],[2],[3],[4],[5],[6],[7],[8],[9],[10],[11],[12],[13],[14],[15],[16],[17],[18],[19],[20],[21],[22],[23],[24],[25],[26],[27],[28],[29],[30],[31],[32],[33],[34],[35],[36],[37],[38],[39],[40],[41],[42],[43],[44],[45],[46],[47]
],
"accelerators": [
{
"id": "00000000:21:00.0",
"type": "Nvidia GPU",
"model": "Nvidia A30"
},
{
"id": "00000000:41:00.0",
"type": "Nvidia GPU",
"model": "Nvidia A30"
},
{
"id": "00000000:A1:00.0",
"type": "Nvidia GPU",
"model": "Nvidia A30"
}
]
}
},
{
"name": "fatgpu",
"processorType": "AMD EPYC 9454 48-Core Processor",
"socketsPerNode": 2,
"coresPerSocket": 48,
"threadsPerCore": 1,
"flopRateScalar": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 962
},
"flopRateSimd": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 5796
},
"memoryBandwidth": {
"unit": {
"base": "B/s",
"prefix": "G"
},
"value": 779
},
"nodes": "fatgpu[001-007]",
"topology": {
"node": [0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95],
"socket": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47],
[48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95]
],
"memoryDomain": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47],
[48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95]
],
"core": [
[0],[1],[2],[3],[4],[5],[6],[7],[8],[9],[10],[11],[12],[13],[14],[15],[16],[17],[18],[19],[20],[21],[22],[23],[24],[25],[26],[27],[28],[29],[30],[31],[32],[33],[34],[35],[36],[37],[38],[39],[40],[41],[42],[43],[44],[45],[46],[47],[48],[49],[50],[51],[52],[53],[54],[55],[56],[57],[58],[59],[60],[61],[62],[63],[64],[65],[66],[67],[68],[69],[70],[71],[72],[73],[74],[75],[76],[77],[78],[79],[80],[81],[82],[83],[84],[85],[86],[87],[88],[89],[90],[91],[92],[93],[94],[95]
],
"accelerators": [
{
"id": "00000000:26:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H100"
},
{
"id": "00000000:2F:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H100"
},
{
"id": "00000000:46:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H100"
},
{
"id": "00000000:54:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H100"
},
{
"id": "00000000:A6:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H100"
},
{
"id": "00000000:AF:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H100"
},
{
"id": "00000000:C6:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H100"
},
{
"id": "00000000:CF:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H100"
}
]
}
},
{
"name": "vis",
"processorType": "AMD EPYC 9254 24-Core Processor",
"socketsPerNode": 2,
"coresPerSocket": 24,
"threadsPerCore": 1,
"flopRateScalar": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 517
},
"flopRateSimd": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 3175
},
"memoryBandwidth": {
"unit": {
"base": "B/s",
"prefix": "G"
},
"value": 588
},
"nodes": "vis[001-003]",
"topology": {
"node": [0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47],
"socket": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23],
[24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47]
],
"memoryDomain": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23],
[24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47]
],
"core": [
[0],[1],[2],[3],[4],[5],[6],[7],[8],[9],[10],[11],[12],[13],[14],[15],[16],[17],[18],[19],[20],[21],[22],[23],[24],[25],[26],[27],[28],[29],[30],[31],[32],[33],[34],[35],[36],[37],[38],[39],[40],[41],[42],[43],[44],[45],[46],[47]
],
"accelerators": [
{
"id": "00000000:81:00.0",
"type": "Nvidia GPU",
"model": "Nvidia A40"
}
]
}
},
{
"name": "h200gpu",
"processorType": "AMD EPYC 9554 64-Core Processor",
"socketsPerNode": 2,
"coresPerSocket": 64,
"threadsPerCore": 1,
"flopRateScalar": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 1230
},
"flopRateSimd": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 7607
},
"memoryBandwidth": {
"unit": {
"base": "B/s",
"prefix": "G"
},
"value": 790
},
"nodes": "h200gpu001",
"topology": {
"node": [0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127],
"socket": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63],
[64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127]
],
"memoryDomain": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63],
[64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127]
],
"core": [
[0],[1],[2],[3],[4],[5],[6],[7],[8],[9],[10],[11],[12],[13],[14],[15],[16],[17],[18],[19],[20],[21],[22],[23],[24],[25],[26],[27],[28],[29],[30],[31],[32],[33],[34],[35],[36],[37],[38],[39],[40],[41],[42],[43],[44],[45],[46],[47],[48],[49],[50],[51],[52],[53],[54],[55],[56],[57],[58],[59],[60],[61],[62],[63],[64],[65],[66],[67],[68],[69],[70],[71],[72],[73],[74],[75],[76],[77],[78],[79],[80],[81],[82],[83],[84],[85],[86],[87],[88],[89],[90],[91],[92],[93],[94],[95],[96],[97],[98],[99],[100],[101],[102],[103],[104],[105],[106],[107],[108],[109],[110],[111],[112],[113],[114],[115],[116],[117],[118],[119],[120],[121],[122],[123],[124],[125],[126],[127]
],
"accelerators": [
{
"id": "00000000:04:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H200"
},
{
"id": "00000000:24:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H200"
},
{
"id": "00000000:44:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H200"
},
{
"id": "00000000:64:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H200"
},
{
"id": "00000000:84:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H200"
},
{
"id": "00000000:A4:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H200"
},
{
"id": "00000000:C4:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H200"
},
{
"id": "00000000:E4:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H200"
}
]
}
},
{
"name": "tcpu",
"processorType": "AMD EPYC 9645 96-Core Processor",
"socketsPerNode": 2,
"coresPerSocket": 96,
"threadsPerCore": 1,
"flopRateScalar": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 1912
},
"flopRateSimd": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 22393
},
"memoryBandwidth": {
"unit": {
"base": "B/s",
"prefix": "G"
},
"value": 892
},
"nodes": "tcpu[001-047]",
"topology": {
"node": [0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128,129,130,131,132,133,134,135,136,137,138,139,140,141,142,143,144,145,146,147,148,149,150,151,152,153,154,155,156,157,158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,182,183,184,185,186,187,188,189,190,191],
"socket": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95],
[96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128,129,130,131,132,133,134,135,136,137,138,139,140,141,142,143,144,145,146,147,148,149,150,151,152,153,154,155,156,157,158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,182,183,184,185,186,187,188,189,190,191]
],
"memoryDomain": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23],
[24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47],
[48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71],
[72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95],
[96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119],
[120,121,122,123,124,125,126,127,128,129,130,131,132,133,134,135,136,137,138,139,140,141,142,143],
[144,145,146,147,148,149,150,151,152,153,154,155,156,157,158,159,160,161,162,163,164,165,166,167],
[168,169,170,171,172,173,174,175,176,177,178,179,180,181,182,183,184,185,186,187,188,189,190,191]
],
"core": [
[0],[1],[2],[3],[4],[5],[6],[7],[8],[9],[10],[11],[12],[13],[14],[15],[16],[17],[18],[19],[20],[21],[22],[23],[24],[25],[26],[27],[28],[29],[30],[31],[32],[33],[34],[35],[36],[37],[38],[39],[40],[41],[42],[43],[44],[45],[46],[47],[48],[49],[50],[51],[52],[53],[54],[55],[56],[57],[58],[59],[60],[61],[62],[63],[64],[65],[66],[67],[68],[69],[70],[71],[72],[73],[74],[75],[76],[77],[78],[79],[80],[81],[82],[83],[84],[85],[86],[87],[88],[89],[90],[91],[92],[93],[94],[95],[96],[97],[98],[99],[100],[101],[102],[103],[104],[105],[106],[107],[108],[109],[110],[111],[112],[113],[114],[115],[116],[117],[118],[119],[120],[121],[122],[123],[124],[125],[126],[127],[128],[129],[130],[131],[132],[133],[134],[135],[136],[137],[138],[139],[140],[141],[142],[143],[144],[145],[146],[147],[148],[149],[150],[151],[152],[153],[154],[155],[156],[157],[158],[159],[160],[161],[162],[163],[164],[165],[166],[167],[168],[169],[170],[171],[172],[173],[174],[175],[176],[177],[178],[179],[180],[181],[182],[183],[184],[185],[186],[187],[188],[189],[190],[191]
]
}
},
{
"name": "th200gpu",
"processorType": "AMD EPYC 9335 32-Core Processor",
"socketsPerNode": 2,
"coresPerSocket": 32,
"threadsPerCore": 1,
"flopRateScalar": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 492
},
"flopRateSimd": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 8919
},
"memoryBandwidth": {
"unit": {
"base": "B/s",
"prefix": "G"
},
"value": 864
},
"nodes": "th200gpu001",
"topology": {
"node": [0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63],
"socket": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31],
[32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63]
],
"memoryDomain": [
[0,1,2,3,4,5,6,7],
[8,9,10,11,12,13,14,15],
[16,17,18,19,20,21,22,23],
[24,25,26,27,28,29,30,31],
[32,33,34,35,36,37,38,39],
[40,41,42,43,44,45,46,47],
[48,49,50,51,52,53,54,55],
[56,57,58,59,60,61,62,63]
],
"core": [
[0],[1],[2],[3],[4],[5],[6],[7],[8],[9],[10],[11],[12],[13],[14],[15],[16],[17],[18],[19],[20],[21],[22],[23],[24],[25],[26],[27],[28],[29],[30],[31],[32],[33],[34],[35],[36],[37],[38],[39],[40],[41],[42],[43],[44],[45],[46],[47],[48],[49],[50],[51],[52],[53],[54],[55],[56],[57],[58],[59],[60],[61],[62],[63]
],
"accelerators": [
{
"id": "00000000:16:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H200"
},
{
"id": "00000000:66:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H200"
},
{
"id": "00000000:96:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H200"
},
{
"id": "00000000:E6:00.0",
"type": "Nvidia GPU",
"model": "Nvidia H200"
}
]
}
},
{
"name": "tl40sgpu",
"processorType": "AMD EPYC 9535 64-Core Processor",
"socketsPerNode": 1,
"coresPerSocket": 64,
"threadsPerCore": 1,
"flopRateScalar": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 590
},
"flopRateSimd": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 7860
},
"memoryBandwidth": {
"unit": {
"base": "B/s",
"prefix": "G"
},
"value": 576
},
"nodes": "tl40sgpu[001-010]",
"topology": {
"node": [0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63],
"socket": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63]
],
"memoryDomain": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15],
[16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31],
[32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47],
[48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63]
],
"core": [
[0],[1],[2],[3],[4],[5],[6],[7],[8],[9],[10],[11],[12],[13],[14],[15],[16],[17],[18],[19],[20],[21],[22],[23],[24],[25],[26],[27],[28],[29],[30],[31],[32],[33],[34],[35],[36],[37],[38],[39],[40],[41],[42],[43],[44],[45],[46],[47],[48],[49],[50],[51],[52],[53],[54],[55],[56],[57],[58],[59],[60],[61],[62],[63]
],
"accelerators": [
{
"id": "00000000:01:00.0",
"type": "Nvidia GPU",
"model": "Nvidia L40S"
},
{
"id": "00000000:21:00.0",
"type": "Nvidia GPU",
"model": "Nvidia L40S"
},
{
"id": "00000000:C1:00.0",
"type": "Nvidia GPU",
"model": "Nvidia L40S"
},
{
"id": "00000000:E1:00.0",
"type": "Nvidia GPU",
"model": "Nvidia L40S"
}
]
}
},
{
"name": "tvis",
"processorType": "AMD EPYC 9535 64-Core Processor",
"socketsPerNode": 2,
"coresPerSocket": 64,
"threadsPerCore": 1,
"flopRateScalar": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 1296
},
"flopRateSimd": {
"unit": {
"base": "F/s",
"prefix": "G"
},
"value": 15758
},
"memoryBandwidth": {
"unit": {
"base": "B/s",
"prefix": "G"
},
"value": 1148
},
"nodes": "tvis[001-002]",
"topology": {
"node": [0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127],
"socket": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63],
[64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127]
],
"memoryDomain": [
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15],
[16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31],
[32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47],
[48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63],
[64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79],
[80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95],
[96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111],
[112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127]
],
"core": [
[0],[1],[2],[3],[4],[5],[6],[7],[8],[9],[10],[11],[12],[13],[14],[15],[16],[17],[18],[19],[20],[21],[22],[23],[24],[25],[26],[27],[28],[29],[30],[31],[32],[33],[34],[35],[36],[37],[38],[39],[40],[41],[42],[43],[44],[45],[46],[47],[48],[49],[50],[51],[52],[53],[54],[55],[56],[57],[58],[59],[60],[61],[62],[63],[64],[65],[66],[67],[68],[69],[70],[71],[72],[73],[74],[75],[76],[77],[78],[79],[80],[81],[82],[83],[84],[85],[86],[87],[88],[89],[90],[91],[92],[93],[94],[95],[96],[97],[98],[99],[100],[101],[102],[103],[104],[105],[106],[107],[108],[109],[110],[111],[112],[113],[114],[115],[116],[117],[118],[119],[120],[121],[122],[123],[124],[125],[126],[127]
],
"accelerators": [
{
"id": "00000000:11:00.0",
"type": "Nvidia GPU",
"model": "Nvidia RTX 4500 Ada"
}
]
}
}
]
}