An AI data center is full of servers, which are in turn full of (for the most part) NVIDIA GPUs. Each NVIDIA GB300 has two B300 GPUs, the two of which have 576GB of High Bandwidth Memory (HBM, or HBM3e to be specific), and a CPU, which has 480GB of lower-power LPDDR5X RAM (the kind usually used in cellphones and other mobile devices). These systems tend to be sold in an NVL72 rack with 18 compute trays, bringing us to 36 GB300s, for a total of 20.7 terabytes of HBM and 17 terabytes of LPDDR5X RAM, and that’s before you get to the RAM associated with the high-speed networking gear and other associated components.
Даже не знаю, брат. Наверное Альтман зарегаться на авито не успел.