A lawyer posting on Reddit under the handle u/TumbleweedNew6515 built a private AI server for $9,450 using 12 used Nvidia Tesla V100 GPUs to run DeepSeek V4.1 Flash locally. The custom cluster hits up to 184 tokens per second on 1 code stream, beating published 4 stacked Nvidia DGX Spark configurations at 50% of the cost of 3 Spark units. But the rig pulls up to 2,100W from the wall and makes too much noise for a normal office.
Matching the model's exact memory footprint keeps slow system RAM out of the equation. DeepSeek V4.1 Flash in Nvidia NVFP4 format has 15,360 routed experts occupying 278.9 GiB spread across 40 layers. Using 8x 32GB cards only yields 254GB forcing extra compression or host memory paging. Going to 12x V100 SXM2's gives us 384GB of HBM2 memory. The rig connects 3 NVlink boards with 4 cards apiece for 3 pipeline stages with 4 way tensor parallel split at layers 14 & 28. Each expert is located right inside the GPU at native precision.
Single user latency is what's important here, more than so called "batch serving" of thousands of prompts. Code generation delivers 157 to 184 tokens/sec, for up to 128K context, then it peaks at 153 at 256K. Legal text on average gives 92 to 102 tokens/sec, clear prose from 83 to 95. A 128K token, cold doc was read in 28sec. Other 128K cached files are rapid. A first token takes 0.4sec. The benchmarks posted on Reddit and by the builder at the PLI Labs site out perform the equivalent of 4 stacked DGX Spark machines by anywhere from 15% to 45% in a single code stream. At 8 or 16 simultaneous users as in, 8 or 16 google like transactions the 4 Sparks (which are running 1 request through their pipeline per step) pull way ahead, for 1 lawyer running Claude Code on his/her group's secure case files.
The parts took some patience on the secondary market. The builder paid $450 apiece for the GPUs, $850 each for 3 NVLink switch boards, and $1,500 for the server chassis $9,450. Prices for used cards near $875 put a new build in the neighborhood of $14,550. That still undercuts 3 DGX Spark boxes (configured as a single unit) at a cost of $18,470. And the older Volta silicon comes with some real physical concessions. The V100 chips lack FP4 and FP8 tensor cores. As a result, the software has to decode the 4 bit weights into FP16 math on the fly, with all of the speed coming strictly from HBM2 memory bandwidth that reads fewer bytes. Cap the cards at 175W, and the box still manages to consume 2,100W of power and is loud enough to need an isolated room.
