It’s also actually feasible for an individual person to get hardware to run it, like if you can one day get your hands on a Mac Studio with 512GB of RAM.
From the article.
Apple announced the M5 Ultra Mac Studio on August 26, 2026, with pre-orders open today and shipping on September 22. The headline number for local AI is 512GB of unified memory at 1.2 TB/s of memory bandwidth, starting at $5,499.
I’m pretty sure it has to be way more than $5500 for the 512GB model. By boss bought a couple (older models) to run local inference at work, and he paid like $20K each.
Ehhh if it’s a hobby you’re really into it’s not a crazy amount, I spent way more than that on motorcycles just for shits and giggles, 5k of photography equipment is a pretty small and sad pile, same with hi-fi, fishing, watches, bicycles etc.
From the article.
https://modelfit.io/blog/mac-studio-m5-ultra-512gb-local-llm/
Can’t find any for sale, because it seems completely unavailable at the moment. That aside, I wouldn’t call a price point of $5500 USD ‘feasible’.
I’m pretty sure it has to be way more than $5500 for the 512GB model. By boss bought a couple (older models) to run local inference at work, and he paid like $20K each.
Ehhh if it’s a hobby you’re really into it’s not a crazy amount, I spent way more than that on motorcycles just for shits and giggles, 5k of photography equipment is a pretty small and sad pile, same with hi-fi, fishing, watches, bicycles etc.