Convergence

MIT researchers introduce Lightning, a reconfigurable photonic-electronic smartNIC that serves 

real-time deep neural network inference requests at 100 Gbps. Credit: Alex Shipps/MIT CSAIL via Midjourney

Computers are getting faster as we all know but the bottleneck of systems becoming even faster centers on the fact systems, at this point in time, don't use photons to do analog when it comes to running AI at truly high level, something not considered doable until now.

Computing is at an inflection point. Moore’s Law, which predicts that the number of transistors on an electronic chip will double each year, is slowing down due to the physical limits of fitting more transistors on affordable microchips. These increases in computer power are slowing down as the demand grows for high-performance computers that can support increasingly complex artificial intelligence models. This inconvenience has led engineers to explore new methods for expanding the computational capabilities of their machines, but a solution remains unclear.

Potential of Photonic Computing

Photonic computing is one potential remedy for the growing computational demands of machine-learning models. Instead of using transistors and wires, these systems utilize photons (microscopic light particles) to perform computation operations in the analog domain. Lasers produce these small bundles of energy, which move at the speed of light like a spaceship flying at warp speed in a science fiction movie. When photonic computing cores are added to programmable accelerators like a network interface card (NIC, and its augmented counterpart, SmartNICs), the resulting hardware can be plugged in to turbocharge a standard computer.

MIT researchers have now harnessed the potential of photonics to accelerate modern computing by demonstrating its capabilities in machine learning. Dubbed “Lightning,” their photonic-electronic reconfigurable SmartNIC helps deep neural networks — machine-learning models that imitate how brains process information — to complete inference tasks like image recognition and language generation in chatbots such as ChatGPT. The prototype’s novel design enables impressive speeds, creating the first photonic computing system to serve real-time machine-learning inference requests.

Tech never sleeps ...

Convergence