Nvidia’s new Blackwell chips are twice as fast as their predecessors in training massive AI models, cutting chip use and time dramatically, new benchmarks reveal.
Nvidia's (NVDA.O), opens new tab newest chips have made gains in training large artificial intelligence systems, new data released on Wednesday showed, with the number of chips required to train large language models dropping dramatically.
MLCommons, a nonprofit group that publishes benchmark performance results for AI systems, released new data about chips from Nvidia and Advanced Micro Devices (AMD.O), opens new tab, among others, for training, in which AI systems are fed large amounts of data to learn from. While much of the stock market's attention has shifted to a larger market for AI inference, in which AI systems handle questions from users, the number of chips needed to train the systems is still a key competitive concern. China's DeepSeek claims to create a competitive chatbot using far fewer chips than U.S. rivals.
The results were the first that MLCommons has released about how chips fared at training AI systems such as Llama 3.1 405B, an open-source AI model released by Meta Platforms (META.O), opens new tab that has a large enough number of what are known as "parameters" to give an indication of how the chips would perform at some of the most complex training tasks in the world, which can involve trillions of parameters.
Nvidia and its partners were the only entrants that submitted data about training that large model, and the data showed that Nvidia's new Blackwell chips are, on a per-chip basis, more than twice as fast as the previous generation of Hopper chips.
In the fastest results for Nvidia's new chips, 2,496 Blackwell chips completed the training test in 27 minutes. It took more than three times that many of Nvidia's previous generation of chips to get a faster time, according to the data.
In a press conference, Chetan Kapoor, chief product officer for CoreWeave, which collaborated with Nvidia to produce some of the results, said there has been a trend in the AI industry toward stringing together smaller groups of chips into subsystems for separate AI training tasks, rather than creating homogenous groups of 100,000 chips or more.
"Using a methodology like that, they're able to continue to accelerate or reduce the time to train some of these crazy, multi-trillion parameter model sizes," Kapoor said.
Uzbek President Shavkat Mirziyoyev’s official visit to Tokyo represents more than a strengthening of bilateral relations; it is a strategic step tha...
AnewZ has premiered The Oligarch’s Design, a long-form investigative documentary marking the launch of AnewZ Investigations, the channel’s new edi...
The foreign ministers of Cambodia and Thailand have told Chinese Foreign Minister Wang Yi that they are willing to pursue a ceasefire, as tensions fla...
The Conservative Party says it would cut funding for green energy projects and redirect the money into defence, arguing the UK needs to be ready for w...
Kazakh President Kassym-Jomart Tokayev’s first official visit to Japan marks a notable moment in relations between the two countries, reflecting a s...
Uzbek President Shavkat Mirziyoyev’s official visit to Tokyo represents more than a strengthening of bilateral relations; it is a strategic step that broadens the economic and diplomatic horizons of the region.
The foreign ministers of Cambodia and Thailand have told Chinese Foreign Minister Wang Yi that they are willing to pursue a ceasefire, as tensions flared along parts of the two countries’ shared border.
Kazakh President Kassym-Jomart Tokayev’s first official visit to Japan marks a notable moment in relations between the two countries, reflecting a shared interest in deepening cooperation.
The United States has suspended the Diversity Visa Lottery programme, commonly known as the Green Card lottery, after a deadly shooting at Brown University.
Ukraine has welcomed the European Union’s decision to provide €90 billion in support over the next two years, calling it a vital lifeline even as the bloc failed to reach agreement on using frozen Russian assets to finance the aid.
European Union foreign policy chief Kaja Kallas has warned that attempts to reach a peace agreement in Ukraine are being undermined by Russia’s continued refusal to engage meaningfully in negotiations.
Petroleum products are being transported by rail from Azerbaijan to Armenia for the first time in decades. The move is hailed as a tangible breakthrough in efforts to normalise relations between the long-time rivals.
U.S. President Donald Trump delivered a wide-ranging address from the White House in which he sought to highlight what he described as his administration’s achievements while laying the groundwork for his plans for the year ahead and beyond, on Wednesday (18 December).
Chinese Foreign Minister Wang Yi has held a phone conversation with his Venezuelan counterpart Yvan Gil at the latter’s request.
Warner Bros Discovery’s board rejected Paramount Skydance’s $108.4 billion hostile bid on Wednesday (17 December), citing insufficient financing guarantees.
Ford Motor Company said on Monday it will take a $19.5 billion writedown and scrap several electric vehicle (EV) models, marking a major retreat from its battery-powered ambitions amid declining EV demand and changes under the Trump administration.
Iran has rolled out changes to how fuel is priced at the pump. The move is aimed at managing demand without triggering public anger.
U.S. stock markets closed lower at the end of the week, as investors continued to rotate out of technology shares, putting pressure on major indices.
The U.S. Federal Reserve’s Federal Open Market Committee (FOMC) cut its benchmark interest rate by 25 basis points to a range of 3.50% to 3.75% following its two-day policy meeting, according to an official statement issued on Wednesday, 10 December.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment