Elon Musk Reveals Plans for Supercomputer with 100,000 GPUs to Enhance Grok Chatbot

By Madz Dizon

May 25, 2024 07:22 PM EDT

Elon Musk Reveals Plans for Supercomputer with 100,000 GPUs to Enhance Grok Chatbot
Tesla CEO Elon Musk speaks at the 27th annual Milken Institute Global Conference at the Beverly Hilton in Los Angeles on May 6, 2024.
(Photo : FREDERIC J. BROWN/AFP via Getty Images)

Elon Musk recently informed investors that his startup xAI has ambitious plans to develop a supercomputer by the fall of 2025. 

This supercomputer will be instrumental in enhancing the capabilities of its Grok chatbot, making it even smarter in the future.

Elon Musk Plans xAI Supercomputer to Enhance Grok Chatbot

According to The Information, Musk described this supercomputer as a massive computing powerhouse. It would be equipped with tens of thousands of NVIDIA H100 GPUs and require a significant investment of billions of dollars to construct.

In previous statements, Musk has indicated that the upcoming iteration of Grok will necessitate a significant boost in the number of chips required.

Specifically, he mentioned that at least 100,000 chips will be needed, which is a fivefold increase compared to the reported 20,000 GPUs currently being utilized for training Grok 2.0.

Musk reportedly informed investors during the presentation that the upcoming GPU cluster would surpass the size of any existing clusters used by xAI competitors by at least four times.

READ NEXT: Walmart Ends Credit Card Deal with Capital One Over Processing Delays 

xAI Could Collaborate With Oracle

The latest version of Grok, 1.5, was released in April. It now has the capability to process not only text but also visual information such as photographs and diagrams. In a recent development, X has begun introducing AI-generated news summaries for its premium users, thanks to the power of Grok.

The report mentioned the possibility of xAI collaborating with Oracle to develop a massive computer. In late 2023, xAI introduced Grok, a new chatbot that competes with other popular chatbots like Microsoft-backed OpenAI's ChatGPT, Google's Bard, and Microsoft's Bing AI. 

READ MORE: SpaceX Considers Selling Shares in Tender Offer, Eyeing $200 Billion Valuation 

© 2024 VCPOST, All rights reserved. Do not reproduce without permission.

Join the Conversation

Real Time Analytics