NVIDIA CEO Unveils Gen AI Platforms for Every Industry

With his first live keynote since the pandemic, NVIDIA founder and CEO Jensen Huang kicked off the COMPUTEX conference in Taipei. In his speech, Huang announced platforms that companies can use to ride a wave of generative AI that’s transforming industries from advertising to manufacturing to telecom.

Speaking for nearly two hours, he described accelerated computing services, software, and systems that are enabling new business models and making current ones more efficient. “Accelerated computing and AI mark a reinvention of computing,“ said Huang. In a demonstration of its power, he used the massive 8K wall he spoke in front of to show a text prompt generating a theme song for his keynote, singable as any karaoke tune.

“We’re now at the tipping point of a new computing era with accelerated computing and AI that’s been embraced by almost every computing and cloud company in the world,“ he said. Huang added that 40,000 large companies and 15,000 startups now use NVIDIA technologies with 25 million downloads of CUDA software last year alone.

For enterprises that need the ultimate in AI performance, he unveiled DGX GH200, a large-memory AI supercomputer. It uses NVIDIA NVLink to combine up to 256 GH200 Grace Hopper Superchips into a single data-center-sized GPU. To fit the needs of data centers of every size, Huang announced NVIDIA MGX, a modular reference architecture for creating accelerated servers. System makers will use it to quickly and cost-effectively build more than a hundred different server configurations to suit a wide range of AI, HPC, and NVIDIA Omniverse applications.

Separately, Huang unveiled NVIDIA Spectrum-X, a networking platform purpose-built to improve the performance and efficiency of Ethernet-based AI clouds. It combines Spectrum-4 Ethernet switches with BlueField-3 DPUs and software to deliver 1.7x gains in AI performance and power efficiency over traditional Ethernet fabrics. With another novelty, called Avatar Cloud Engine (ACE) for Games, foundry service developers can build and deploy custom AI models for speech, conversation, and animation. It will give non-playable characters conversational skills so they can respond to questions with lifelike personalities that evolve.