ST Silicon Photonics and BiCMOS Technologies for AI Optical Interconnects
Artificial intelligence (AI) is transforming industries, driving innovation and efficiency. However, sustainable AI growth requires addressing key challenges, including energy consumption.
AI large language models (LLMs) demand significant computational power, leading to high energy consumption. Industry executives predict a 100-fold increase in computes required for next-generation LLM training, with energy needs multiplying by 10 every two years.
The processing of LLMs is typically partitioned over different accelerators to optimize performance, driving key parameter needs.
Recent comments from industry executives anticipate a factor of 100 times more computes required for the next generation of LLM training.
Author's summary: ST silicon photonics and BiCMOS technologies offer a solution for AI optical interconnects.