blog
Notes on AI hardware, systems, and the infrastructure underneath intelligent machines.
Scaling AI: The Communication Wall
As models and clusters grow, communication becomes a first-order systems constraint. A tour of the interconnect hierarchy, synchronization, collective algorithms, and the copper–optics crossover.
Read the thread →