Meanwhile, for inference, Nvidia says its rack scale configuration is up to 30x faster — in part because various degrees of data, pipeline, tensor, and expert parallelism can be employed to take ...

Meanwhile, competitor AMD is firing on all cylinders. AMD announced its next-generation Helios rack-scale AI solution earlier this month.