Goodeye8

Unless you’re planning on buying the whole rack you’re not scooping up anything, except maybe the hard drives. The memory and GPUs are not consumer grade hardware. Some of the GPUs you technically could hook up to your PC, for example the Nvidia A6000, but its launch price was ~$4500 so even on the cheaper end you’re shelling out probably $3000 for a card that (out the box) is marginally better than the 4070ti. Most of the GPUs and pretty much all of the memory is not compatible with your standard consumer grade MoBos.

And for obvious reasons I think the minimum age has to be 18 so really you should start at 69 (heh, nice).

Setting up a local model was specifically about people who take privacy and security seriously because that often requires sacrificing convenience, which in this case would be having to build a suitable server and learning the necessary know-how of setting up your own local model. Casual consumers don’t really think about privacy so they’re going to go with the most convenient option, which is whatever service the major players will provide.

As for Dell keeping the NPUs I forgot they’re going to be bundled with processors.

I’m not that concerned with the hardware limitations. Nobody is going to run a full-blown LLM on their laptop, running one on a desktop would already require building a PC with AI in mind. What you’re going to see being used locally are going smaller models (something like 7B using INT8 or INT4). Factor in the efficiency of an NPU and you could get by with 16GB of memory (especially if the models are used in INT4) with little extra power draw and heat. The only hardware concern would be the technological advancement speed of NPUs, but just don’t be an early adopter and you’ll probably be fine.

But this is where Dells point comes in. Why should the consumer care? What benefits do consumers get by running a model locally? Outside of privacy and security reasons you’re simply going to get a better result by using one of the online AI services because you’d be using a proper model instead of the cheap one that runs with limited hardware. And even for the privacy and security minded people you can just build your own AI server (maybe not today but when hardware prices get back to normal) that you run from home and then expose that to your laptop or smartphone. For consumers to desire running a local model (actually locally and not in a selfhosting kind of way) there would have to be some problem that the local model solve that the over the internet solution can’t solve. So far such a problem doesn’t exist today and there doesn’t seem to be a suitable problem on the horizon either.

Dell is keeping their foot in the door by still implementing NPUs into their laptops, so if by some miracle some magical problem is found that AI solves they’re ready, but they realize that NPUs are not something they can actually use as a selling point because as it stands, NPUs solve no problems because there’s no benefit to running small models locally.

Considering they can’t even properly redact I think you’re giving them too much credit.

This is wrong in so many levels.

First of all the vote wasn’t for the whole Union because there were countries that outright rejected the idea of the union and never voted in the first place. 76% is only of the number people who voted actually voted, that’s not indicative of the whole union.

And secondly the vote was for a reformed Union, not a continuation of the existing union. If the course of events had continued in the reformation of the union the union we know in the history books still would’ve ceased to exist.

And finally, with this not being a fact but generally accepted in the academia, people voted for stability not for the union. When it became apparent there won’t be any stability people decided to fend for themselves. By the time Yeltsin dissolved the union it was already on its death bed.

It’s also why none of the countries stayed socialist, because soviet socialism was a failure and instead of taking the time to figure out what a functional socialism would look like countries went with what seemingly worked, capitalism. Stability was more important than staying socialist, especially when the only empirical evidence of socialism was ultimately a failure.