

honestly servers don’t need the latest hardware: just build using DDR4 (or even DDR3): it’s half the price per GB or less each step down, and honestly the biggest reason you want RAM in a server is for a ZFS cache, which is going to be bottlenecked on plenty of other things far before your RAM speed (IMO; i’ve done exactly 0 testing)
(though the max size of a DDR3 module is 8GB so on most consumer hardware that will limit you to 32GB total)


they might, but the point is the volume of data rather than the speed… CERN is obviously an outlier, but not by as much as you’d think. copious amounts of data is kinda par for the course in a lot of cases, and training data just doesn’t even come close to the volume of data that large data users produce (data warehouses/lakes in the order of PB and EB are not that uncommon)