Ya, these high memory amounts and ever increasing memory bandwidth are heavily (but not only) targeting people wanting to run local large AI models like a full deepseek on their machines.

You might not be able to train as well on them as NVIDIA + CUDA, but for local inference, they’re an alternative to NVIDIA and more reasonably priced for the model sizes you can run, and each iteration they get better as the bandwidth increases.