The deal about Hugh's system is that it uses a CPU/GPU/NPU system that is designed to run local LLMs better than most PCs, because they can allocate 96GB (or more) to video RAM. This is a major obstacle to regular PCs, in which the most powerful graphics card, the $6,000 RTX 5090, only comes with 32GB VRAM.

While the Minisforum that Hugh has (and the slightly cheaper GMKtec one with the same chipset that I have) are expensive compared to other MiniPCs, they are still way cheaper than the other players in this particular field: the Mac Studio M3 Ultra and systems based on the Nvidia DGX Spark architecture which generally cost $5,000 and up.

- Evan