Yeah. But they’re slow because most of us are GPU peasants. If someone were willing to drop $3-5K on a rig, they could probably run decent, dense models at greater than cloud speeds. Hell, with enough black magic, they could do it with less, but they’d have to go deep into the weeds.
OTOH, $3-5K buys you a shit ton on Open Router, Claude, Chat, Lumo etc.
The game is entirely rigged for “you will own nothing and be happy about it”.
Yes. People occasionally talk about pooling resources / creating a co-op to buy something like this. Easier to split $200K purchase (and probably $10k/month electricity costs) if 200-2000 people chip in. But then…that’s just the cloud with extra steps.
Can’t says I’ve ever seen a co-op like that work but ICBW
Yeah. But they’re slow because most of us are GPU peasants. If someone were willing to drop $3-5K on a rig, they could probably run decent, dense models at greater than cloud speeds. Hell, with enough black magic, they could do it with less, but they’d have to go deep into the weeds.
OTOH, $3-5K buys you a shit ton on Open Router, Claude, Chat, Lumo etc.
The game is entirely rigged for “you will own nothing and be happy about it”.
If I buy a rig I might as well host it on the internet to get back some of the investment and sell the compute to others … wait a minute that’s cloud!
It’s always cheaper to have the same hardware serve multiple people than just one.
Yes. People occasionally talk about pooling resources / creating a co-op to buy something like this. Easier to split $200K purchase (and probably $10k/month electricity costs) if 200-2000 people chip in. But then…that’s just the cloud with extra steps.
Can’t says I’ve ever seen a co-op like that work but ICBW