Nvidia’s new Blackwell chips are twice as fast as their predecessors in training massive AI models, cutting chip use and time dramatically, new benchmarks reveal.
Nvidia's (NVDA.O), opens new tab newest chips have made gains in training large artificial intelligence systems, new data released on Wednesday showed, with the number of chips required to train large language models dropping dramatically.
MLCommons, a nonprofit group that publishes benchmark performance results for AI systems, released new data about chips from Nvidia and Advanced Micro Devices (AMD.O), opens new tab, among others, for training, in which AI systems are fed large amounts of data to learn from. While much of the stock market's attention has shifted to a larger market for AI inference, in which AI systems handle questions from users, the number of chips needed to train the systems is still a key competitive concern. China's DeepSeek claims to create a competitive chatbot using far fewer chips than U.S. rivals.
The results were the first that MLCommons has released about how chips fared at training AI systems such as Llama 3.1 405B, an open-source AI model released by Meta Platforms (META.O), opens new tab that has a large enough number of what are known as "parameters" to give an indication of how the chips would perform at some of the most complex training tasks in the world, which can involve trillions of parameters.
Nvidia and its partners were the only entrants that submitted data about training that large model, and the data showed that Nvidia's new Blackwell chips are, on a per-chip basis, more than twice as fast as the previous generation of Hopper chips.
In the fastest results for Nvidia's new chips, 2,496 Blackwell chips completed the training test in 27 minutes. It took more than three times that many of Nvidia's previous generation of chips to get a faster time, according to the data.
In a press conference, Chetan Kapoor, chief product officer for CoreWeave, which collaborated with Nvidia to produce some of the results, said there has been a trend in the AI industry toward stringing together smaller groups of chips into subsystems for separate AI training tasks, rather than creating homogenous groups of 100,000 chips or more.
"Using a methodology like that, they're able to continue to accelerate or reduce the time to train some of these crazy, multi-trillion parameter model sizes," Kapoor said.
Kazakhstan and the European Union are bolstering their economic partnership, with a recent high-level meeting paving the way for expanded collaboration in trade, investment, and sustainable development.
The European Commission confirmed on Thursday it will postpone the implementation of new international banking regulations by a year, citing concerns over global alignment and competitiveness.
China is set to eliminate tariffs for all 53 African countries it has diplomatic ties with, offering duty-free access not just to the poorest nations but also to middle-income economies.
The European Union and Britain reached a landmark agreement Wednesday to ease border crossings in Gibraltar, ending years of uncertainty over the territory’s post-Brexit status.
Kazakhstan and the European Union are bolstering their economic partnership, with a recent high-level meeting paving the way for expanded collaboration in trade, investment, and sustainable development.
The European Commission confirmed on Thursday it will postpone the implementation of new international banking regulations by a year, citing concerns over global alignment and competitiveness.
Kazakh Tourism National Company has introduced a draft concept to transform the historic Baikonur cosmodrome into a future-focused destination for scientific and industrial tourism. The plan aims to attract visitors year-round, beyond just the times of rocket launches.
China is set to eliminate tariffs for all 53 African countries it has diplomatic ties with, offering duty-free access not just to the poorest nations but also to middle-income economies.
Start your day informed with AnewZ Morning Brief: here are the top news stories for June 8th, covering the latest developments you need to know.
Presidential candidate Miguel Uribe Turbay is in critical condition after being shot three times — including twice in the head — during a campaign event in Bogotá.
Kazakhstan and the UK are strengthening defense ties with a new Military Cooperation Plan, focusing on peacekeeping and military education.
A 30-year-old woman was shot by police in Munich on Saturday evening after stabbing two people at Theresienwiese, a central park best known for hosting Oktoberfest.
Mexican President Claudia Sheinbaum has condemned U.S. immigration raids and National Guard deployment in Los Angeles, calling for reforms instead of enforcement.
US producer prices rose 2.6% annually in May, matching market expectations, with a modest 0.1% increase from April, the US Bureau of Labor Statistics reported.
The European Commission confirmed on Thursday it will postpone the implementation of new international banking regulations by a year, citing concerns over global alignment and competitiveness.
The euro surged to its highest level in nearly four years against the U.S. dollar, as global investors turned to safe-haven assets amid growing geopolitical tensions and uncertainty surrounding the U.S.-China trade deal.
The U.S. Energy Information Administration (EIA) has slightly increased its forecast for Brent crude oil prices in 2025, despite expectations of growing global stockpiles.
South Korea's main stock index, the Korea Composite Stock Price Index (KOSPI), rose by 35.19 points, or 1.23%, on Wednesday, closing at 2,907.04. This marks its highest closing level since 14 January, 2022, when it reached 2,921.92 points.
Kazakhstan and the European Union are bolstering their economic partnership, with a recent high-level meeting paving the way for expanded collaboration in trade, investment, and sustainable development.
The European Commission confirmed on Thursday it will postpone the implementation of new international banking regulations by a year, citing concerns over global alignment and competitiveness.
Kazakh Tourism National Company has introduced a draft concept to transform the historic Baikonur cosmodrome into a future-focused destination for scientific and industrial tourism. The plan aims to attract visitors year-round, beyond just the times of rocket launches.
China is set to eliminate tariffs for all 53 African countries it has diplomatic ties with, offering duty-free access not just to the poorest nations but also to middle-income economies.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment