Shared rig
Michael Gannotti's AI lab
2 nodes / 256GB aggregate / 200GbE
Build by
@MichaelGannotti
on X
About this rig
Re-added more elements to my AI lab setup. A multi-node local inference rig built around NVIDIA DGX Spark with additional GPUs and networking gear, wired for always-on agent workloads.
Components
NVIDIA DGX Spark 128GB
primary gpu
NVIDIA DGX Spark 128GB
primary gpu
Models this rig can run
Computed from 256GB of pooled memory, keeping 8 percent for the OS, runtime and context. Throughput is a ceiling from memory bandwidth, not a measured number.
Llama 3.1 405B
4-bit · 202.5GB · ~1 tok/s
Ornith-1.5-397B
4-bit · 201.5GB · ~1 tok/s
Ornith-1.0-397B
4-bit · 198.5GB · ~1 tok/s
K2 Horizon 375B
4-bit · 187.5GB · ~1 tok/s
GLM-5.3-Flash
4-bit · 160.0GB · ~18 tok/s
MiMo-V2.6-Flash
4-bit · 154.5GB · ~22 tok/s
DeepSeek V4 Flash
4-bit · 142.0GB · ~25 tok/s
DeepSeek V4 Flash 0731
4-bit · 142.0GB · ~25 tok/s
Qwen3 235B A22B
8-bit · 235.0GB · ~7 tok/s
Qwen3.8-Flash-Next
8-bit · 180.0GB · ~27 tok/s
Qwen3.8-Omni-Flash
8-bit · 125.0GB · ~1 tok/s
Command R+ 104B
8-bit · 104.0GB · ~2 tok/s
Claim your /u/name
Then build and share a rig like this one - free