AI is rapidly advancing and could soon handle tasks that typically take humans weeks to complete. A recent analysis shows that AI models are closing the performance gap, with the potential to transform industries by taking on complex, time-consuming projects more efficiently.
Artificial intelligence (AI) systems are making significant strides and may soon be able to tackle complex tasks that typically take humans weeks to complete, according to recent analysis. While current AI models still lag behind humans in handling lengthy tasks, their rapid improvement suggests that they could close this gap sooner than anticipated.
METR, a non-profit organization based in Berkeley, California, has been evaluating AI models’ performance across nearly 170 real-world tasks, including coding, cybersecurity, general reasoning, and machine learning. The team measured how long it typically takes expert programmers to complete these tasks and established a ‘human baseline.’
In order to assess AI’s progress, METR introduced a new metric called the ‘task-completion time horizon.’ This metric tracks the time it takes for AI models to complete tasks at a specified success rate, compared to how long it would take human experts to do the same.
According to a preprint released by METR on arXiv this week, earlier AI models such as GPT-2, released by OpenAI in 2019, were unable to complete tasks that took human experts more than a minute. More recent models, such as Anthropic's Claude 3.7 Sonnet, launched in February, completed 50% of tasks that would typically take humans 59 minutes.
The study reveals a striking pattern: the time horizon for the leading 13 AI models has doubled approximately every seven months since 2019. However, the growth rate has accelerated in 2024, with the latest models doubling their time horizon roughly every three months. If this trend continues, METR predicts that AI models will be able to tackle tasks requiring one month of human expertise with 50% reliability by 2029, or possibly even sooner.
The implications of this rapid progress are vast. Tasks that take a month of human effort could range from starting a new company to making groundbreaking scientific discoveries. However, some experts are cautious about extrapolating these findings too far. Joshua Gans, a professor at the University of Toronto, argues that while extrapolations are tempting, there remains considerable uncertainty about how AI will actually be deployed in real-world scenarios.
Assessing AI’s Capabilities
METR’s analysis, which focuses on a 50% success rate for task completion, offers a more stable and robust approach than other methods. By choosing this middle ground, the team ensured that minor fluctuations in data distribution wouldn’t significantly impact the results. The study also explored the impact of raising the reliability threshold to 80%, which reduced the average time horizon by a factor of five, though the overall doubling trend remained similar.
AI’s improvements over the past five years can largely be attributed to advances in model scale—such as the amount of training data and the number of parameters used in the models. METR credits the progress in time horizon to advancements in AI’s logical reasoning, tool usage, error correction, and self-awareness.
The time horizon metric helps overcome some of the limitations of traditional AI benchmarks, which often fail to accurately reflect real-world work and quickly reach a plateau. As AI continues to improve, the metric provides a continuous, intuitive measure that better captures long-term progress.
While current AI models excel in specific benchmarks, their broader economic impact has been relatively limited. According to METR, the best models currently operate within a time horizon of around 40 minutes, a timeframe that doesn’t necessarily align with highly valuable economic tasks. However, AI researcher and entrepreneur Anton Troynikov argues that AI could have a more significant economic impact if organizations were more willing to experiment with and invest in these models.
The Future of AI and Economic Impact
The ongoing advancements in AI indicate that, as models continue to improve, they may eventually be able to handle tasks that would otherwise require weeks of human effort. However, for this potential to be fully realized, it will require both technological progress and a shift in how organizations deploy and integrate AI into their operations.
As AI continues to evolve, its role in shaping industries and driving innovation could become even more profound. While the path forward remains uncertain, one thing is clear: the future of AI holds immense potential, and its rapid progress could soon reshape how we approach complex tasks.
A U.S. delegation aims to advance negotiations for a ceasefire in Ukraine, beginning with discussions focused on the Black Sea during talks with Russian officials on Monday.
Israel's parliamentary finance committee approved the 2025 state budget late on Sunday, paving the way for a final parliamentary vote before the March 31 deadline, crucial to preventing the government's collapse.
Ukrainian and U.S. officials held discussions on Sunday regarding proposals to protect Ukraine's energy facilities and critical infrastructure. The meeting in Saudi Arabia is part of U.S. President Donald Trump's diplomatic drive aimed at ending the ongoing three-year conflict.
President Donald Trump announced on Friday that the Small Business Administration (SBA) will assume control of the Department of Education’s massive student loan portfolio, as part of his broader effort to dismantle the agency and shift greater power over education to the states.
The Department of Defense has initiated an investigation into recent unauthorized disclosures of national security information, announcing that polygraph tests will be used as part of the probe, according to a memo published on the department’s website on Friday.
A U.S. delegation aims to advance negotiations for a ceasefire in Ukraine, beginning with discussions focused on the Black Sea during talks with Russian officials on Monday.
Israel's parliamentary finance committee approved the 2025 state budget late on Sunday, paving the way for a final parliamentary vote before the March 31 deadline, crucial to preventing the government's collapse.
Ukrainian and U.S. officials held discussions on Sunday regarding proposals to protect Ukraine's energy facilities and critical infrastructure. The meeting in Saudi Arabia is part of U.S. President Donald Trump's diplomatic drive aimed at ending the ongoing three-year conflict.
President Donald Trump announced on Friday that the Small Business Administration (SBA) will assume control of the Department of Education’s massive student loan portfolio, as part of his broader effort to dismantle the agency and shift greater power over education to the states.
The Department of Defense has initiated an investigation into recent unauthorized disclosures of national security information, announcing that polygraph tests will be used as part of the probe, according to a memo published on the department’s website on Friday.
Sweden’s Prime Minister Ulf Kristersson stated on Thursday that purchasing U.S. weapons does not pose a security risk for his country, but emphasized the need for Europe to reduce its reliance on American defense systems. His comments come amid growing discussions within Europe.
NASA astronauts Butch Wilmore and Suni Williams completed an unexpectedly long 286-day mission on the ISS, returning to Earth aboard a SpaceX capsule after delays caused by technical issues with Boeing’s Starliner.
In a groundbreaking study published in Cell on January 18, Chinese researchers have unveiled a novel cancer treatment that ingeniously disguises tumors as pig tissue, triggering the body’s immune system to mount a hyperacute rejection response against the cancer cells.
Russian President Vladimir Putin agreed on Tuesday to a proposal by U.S. President Donald Trump that Russia and Ukraine cease attacking each other's energy infrastructure for 30 days, the Kremlin said following a lengthy phone discussion between the leaders.
Serbia’s parliament has officially accepted the resignation of Prime Minister Milos Vucevic, setting a 30-day deadline for the formation of a new government or the calling of snap elections.
Chinese tech giant Tencent on Friday night launched the official version of its T1 reasoning model, marking a significant step in its bid to strengthen its foothold in the rapidly evolving artificial intelligence landscape.
In the deserts of Namibia, Oman, and Saudi Arabia, scientists have uncovered strange, organized tubes embedded in ancient marble and limestone, sparking speculation that they may be the work of long-extinct microbial life. These unexpected formations could not only redefine our understanding of life
Nvidia CEO Jensen Huang forecasted a rapid arrival of humanoid robots in manufacturing, stating that widespread use in factory settings is likely within the next few years.
A massive, unanticipated disconnection of data centers in a 30-square-mile area outside Washington, D.C. has exposed a fresh vulnerability in America’s electrical grid, raising concerns that the rapid expansion of Big Tech’s energy-hungry facilities could trigger cascading outages.
U.S. Commerce Department bureaus have reportedly issued a blanket ban on the Chinese AI model DeepSeek for use on government-furnished equipment, according to sources and a mass email seen by Reuters.
A U.S. delegation aims to advance negotiations for a ceasefire in Ukraine, beginning with discussions focused on the Black Sea during talks with Russian officials on Monday.
Israel's parliamentary finance committee approved the 2025 state budget late on Sunday, paving the way for a final parliamentary vote before the March 31 deadline, crucial to preventing the government's collapse.
Ukrainian and U.S. officials held discussions on Sunday regarding proposals to protect Ukraine's energy facilities and critical infrastructure. The meeting in Saudi Arabia is part of U.S. President Donald Trump's diplomatic drive aimed at ending the ongoing three-year conflict.
President Donald Trump announced on Friday that the Small Business Administration (SBA) will assume control of the Department of Education’s massive student loan portfolio, as part of his broader effort to dismantle the agency and shift greater power over education to the states.
The Department of Defense has initiated an investigation into recent unauthorized disclosures of national security information, announcing that polygraph tests will be used as part of the probe, according to a memo published on the department’s website on Friday.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment