We propose an HPC network architecture with co-packaged optics enabling 128-port 51.2-Tb/s switches. Simulations for a >34,000-GPU system show up to 11.2× throughput improvement over a Summit-like supercomputer, opening the way to direct-network-attached GPUs.
