Skip to content
Shared rig

Michael Gannotti's AI lab

2 nodes / 256GB aggregate / 200GbE

Build by @MichaelGannotti on X
Michael Gannotti's AI lab rig photo

About this rig

Re-added more elements to my AI lab setup. A multi-node local inference rig built around NVIDIA DGX Spark with additional GPUs and networking gear, wired for always-on agent workloads.

Components

NODE 1
NVIDIA DGX Spark 128GB primary gpu
NODE 2
NVIDIA DGX Spark 128GB primary gpu

Models this rig can run

Computed from 256GB of pooled memory, keeping 8 percent for the OS, runtime and context. Throughput is a ceiling from memory bandwidth, not a measured number.

Llama 3.1 405B 4-bit · 202.5GB · ~1 tok/s
Ornith-1.5-397B 4-bit · 201.5GB · ~1 tok/s
Ornith-1.0-397B 4-bit · 198.5GB · ~1 tok/s
K2 Horizon 375B 4-bit · 187.5GB · ~1 tok/s
GLM-5.3-Flash 4-bit · 160.0GB · ~18 tok/s
MiMo-V2.6-Flash 4-bit · 154.5GB · ~22 tok/s
DeepSeek V4 Flash 4-bit · 142.0GB · ~25 tok/s
DeepSeek V4 Flash 0731 4-bit · 142.0GB · ~25 tok/s
Qwen3 235B A22B 8-bit · 235.0GB · ~7 tok/s
Qwen3.8-Flash-Next 8-bit · 180.0GB · ~27 tok/s
Qwen3.8-Omni-Flash 8-bit · 125.0GB · ~1 tok/s
Command R+ 104B 8-bit · 104.0GB · ~2 tok/s
Find models for this hardware
Claim your /u/name Then build and share a rig like this one - free