Meta shows interest in NVIDIA’s new graphics card chip and is already placing orders

Just recently, NVIDIA presented its new B200 chip at this year’s GTC. According to Reuters employees Katie Paul, Stephen Nellis and Max Cherney, the company Meta is showing strong interest in this chip and has also started to order it.

NVIDIA goes MCM und kündigt Blackwell auf der GTC 2024 offiziell an: Details zum Monster-Chip

Mark Zuckerberg’s company Meta is already expecting delivery of the chip this year. According to NVIDIA, the B200 chip will be 30 times faster at its tasks. These include providing answers from chatbots, although there were no specific details on how well it performs when working with huge amounts of data. The chips are then used to train the company’s Llama models.

In a nutshell, the B200 is a chip from NVIDIA’s Blackwell architecture, which is developed using a 4NP TSMC process. It is based on a multi-chip module, which is connected by a 10 TB/second chip-to-chip connection in a uniform GPU. This contains an HBM3E graphics memory of up to 192 GB. The data bandwidth of the chip reaches a performance of up to 8 TB per second. It is equipped with 208 billion transistors and offers up to 4x performance in AI training, up to 30x performance in AI inferencing and 25x higher energy efficiency.

Meta is one of NVIDIA’s largest customers, having purchased hundreds of thousands of previous generation chips to support the expansion of content recommendation systems and generative AI products. Meta CEO Mark Zuckerberg also announced some time ago that they plan to have up to 350,000 H100 chips in their companies by the end of the year. In combination with other GPUs, Meta would have the equivalent of around 600,000 H100s by then.

This is an important step for Meta to further develop its products and also plays an important role for NVIDIA, as serving such large customers also increases its leading role in the industry.

Source: Reuters