AMD debuts AMD Instinct MI350 Series accelerator chips with 35X better inferencing
1 min read
Summary
Chip maker AMD has unveiled an AI platform it claims is four times faster at running AI compute tasks and 35 times faster at handling inferencing compared with previous chips.
As part of the launch, the Santa Clara-based company has also released the AMD Instinct MI350 Series of GPUs, which improve efficiency and scalability for AI and high-performance tasks.
CEO of AMD, Lisa Su, said the increased energy efficiency of the new chips meant that a typical AI model could be trained using 95% less electricity, and foresees a future where a model that requires 275 racks today could be trained using just one fully utilised rack by 2030.
The chips are already being used by Meta, Oracle and Microsoft, among others.