Evan's new toy: GMKtec EVO-X2 AI Mini PC
Evan mentioned that he now has a GMKtec EVO-X2 AI Mini PC. He is intending to use it for running AI models locally. Here's an interesting review of the unit: <https://www.servethehome.com/gmktec-evo-x2-review-an-amd-ryzen-ai-max-395-powerhouse/> Although it is expensive (US$2000), it is perhaps the cheapest platform that can reasonably run AI models that are not small. It's not amazing at this, but amazing requires a lot more money. The top configuration has 128G of lpddr5 RAM, and 96G of that can be dedicated to the GPU. This is much better than ordinary consumer GPUs. For example, the Nvidia RTX 5090 has 32G of RAM and starts at US$2500 (if your model fits in 32G, the 5090 should run considerably faster than the EVO-X2). The end of the review mentions alternatives.
On Wed, Jul 16, 2025, 10:41 D. Hugh Redelmeier via Talk < talk@lists.gtalug.org> wrote:
Evan mentioned that he now has a GMKtec EVO-X2 AI Mini PC. He is intending to use it for running AI models locally.
Here's an interesting review of the unit: < https://www.servethehome.com/gmktec-evo-x2-review-an-amd-ryzen-ai-max-395-po...
The top configuration has 128G of lpddr5 RAM, and 96G of that can be dedicated to the GPU. This is much better than ordinary consumer GPUs. For example, the Nvidia RTX 5090 has 32G of RAM and starts at US$2500 (if your model fits in 32G, the 5090 should run considerably faster than the EVO-X2).
I refer folks to an earlier email thread in which Hugh and I also talked about such systems, to which any good comparison should include high-end M4-based Mac minis. https://lists.gtalug.org/archives/list/talk@lists.gtalug.org/message/VAEWQNE... Evan Leibovitch, Toronto Canada @evanleibovitch / @el56
participants (2)
-
D. Hugh Redelmeier -
Evan Leibovitch