Meta Announced Its New AI Chip

Meta Platforms unveiled the second generation of its Meta Training and Inference Accelerator (MTIA) AI chip. The company created the chip to wean itself off more costly semiconductors from Nvidia and other vendors.

The company stated it could achieve greater efficiency by controlling its own stack and using its domain-specific silicon than it could with outside GPUs. It stated the latest MTIA chip more than doubles the compute and memory bandwidth of the first while maintaining a close tie-in to their workloads.

Meta Platforms deployed MTIA in its data centers and stated the chip is now serving models in production. Results to date show the MTIA chip can perform low and high complexity ranking and recommendation models, which Meta Platforms stated are key components for its products. The company explained it currently has several programs underway to expand the scope of MTIA, including support for generative AI workloads.