Nvidia’s new Blackwell chips are twice as fast as their predecessors in training massive AI models, cutting chip use and time dramatically, new benchmarks reveal.
Nvidia's (NVDA.O), opens new tab newest chips have made gains in training large artificial intelligence systems, new data released on Wednesday showed, with the number of chips required to train large language models dropping dramatically.
MLCommons, a nonprofit group that publishes benchmark performance results for AI systems, released new data about chips from Nvidia and Advanced Micro Devices (AMD.O), opens new tab, among others, for training, in which AI systems are fed large amounts of data to learn from. While much of the stock market's attention has shifted to a larger market for AI inference, in which AI systems handle questions from users, the number of chips needed to train the systems is still a key competitive concern. China's DeepSeek claims to create a competitive chatbot using far fewer chips than U.S. rivals.
The results were the first that MLCommons has released about how chips fared at training AI systems such as Llama 3.1 405B, an open-source AI model released by Meta Platforms (META.O), opens new tab that has a large enough number of what are known as "parameters" to give an indication of how the chips would perform at some of the most complex training tasks in the world, which can involve trillions of parameters.
Nvidia and its partners were the only entrants that submitted data about training that large model, and the data showed that Nvidia's new Blackwell chips are, on a per-chip basis, more than twice as fast as the previous generation of Hopper chips.
In the fastest results for Nvidia's new chips, 2,496 Blackwell chips completed the training test in 27 minutes. It took more than three times that many of Nvidia's previous generation of chips to get a faster time, according to the data.
In a press conference, Chetan Kapoor, chief product officer for CoreWeave, which collaborated with Nvidia to produce some of the results, said there has been a trend in the AI industry toward stringing together smaller groups of chips into subsystems for separate AI training tasks, rather than creating homogenous groups of 100,000 chips or more.
"Using a methodology like that, they're able to continue to accelerate or reduce the time to train some of these crazy, multi-trillion parameter model sizes," Kapoor said.
Egypt on Friday blamed Ethiopia for “reckless and irresponsible” management of the Nile, saying unilateral operations at the Grand Ethiopian Renai...
The U.S. carried out a strike on Friday against a “narco-trafficking vessel” off the coast of Venezuela, killing four people aboard, Pentagon chie...
Sean “Diddy” Combs is awaiting sentencing in Manhattan federal court, where Judge Arun Subramanian will decide how long the hip-hop mogul spends i...
The 2027 FIFA Under-20 World Cup will mark a first for global football, with Azerbaijan and Uzbekistan set to co-host a tournament that bridges contin...
British police said on Friday they may have accidentally shot two victims, including one who died, in their attempts to bring under control an attack ...
Egypt on Friday blamed Ethiopia for “reckless and irresponsible” management of the Nile, saying unilateral operations at the Grand Ethiopian Renaissance Dam (GERD) have worsened flooding in Sudan and pose a direct threat to Egyptian lands and lives.
Sean “Diddy” Combs is awaiting sentencing in Manhattan federal court, where Judge Arun Subramanian will decide how long the hip-hop mogul spends in prison. The ruling is expected later today.
The U.S. carried out a strike on Friday against a “narco-trafficking vessel” off the coast of Venezuela, killing four people aboard, Pentagon chief Pete Hegseth said.
British police said on Friday they may have accidentally shot two victims, including one who died, in their attempts to bring under control an attack on a Manchester synagogue during Yom Kippur, the holiest day in the Jewish calendar.
A day of mourning has been declared in Portugal to pay respect to victims who lost their lives in the Lisbon Funicular crash which happened on Wednesday evening.
Video from the USGS (United States Geological Survey) showed on Friday (19 September) the Kilauea volcano in Hawaii erupting and spewing lava.
At least eight people have died and more than 90 others were injured following a catastrophic gas tanker explosion on a major highway in Mexico City’s Iztapalapa district on Wednesday, authorities confirmed.
At least 69 people have died and almost 150 injured following a powerful 6.9-magnitude earthquake off the coast of Cebu City in the central Visayas region of the Philippines, officials said, making it one of the country’s deadliest disasters this year.
A powerful 7.4-magnitude earthquake struck off Russia’s Kamchatka Peninsula on 13 September with no tsunami threat, coming just weeks after the region endured a devastating 8.8-magnitude quake — the strongest since 1952.
Shein is opening its first permanent physical stores in France, starting in Paris and expanding to five more cities. The fast-fashion giant aims to test brick-and-mortar retail in one of the world’s most influential fashion markets.
Tesla sales hit a record 497,099 vehicles in Q3 as buyers rushed before the U.S. tax credit expired according to reports. Despite the surge, experts warn the gains may not last amid rising competition.
American soybean farmers are struggling as China, once their largest buyer, shifts purchases to Argentina amid trade tensions and export incentives.
U.S.-based aviation company Boeing is preparing to produce a new narrow-body, single-aisle aircraft to replace its 737 Max model, sources report.
The Organization of Petroleum exporting countries OPEC+ is likely to consider a larger oil production increase of 411,000 barrels per day for November at its meeting next Sunday as rising oil prices encourage the group to try to regain more market share, said sources familiar with the talks.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment