The AA Omniscience benchmark of AI knowledge and hallucination was created by Artificial Analysis, an independent, venture-backed benchmarking company based in San Francisco. Originally launched in November 2025, this comprehensive benchmark covers 6,000 questions across six major domains (business, law, health, software, science and the humanities). Artificial Analysis published its quarterly update on October 1st…
“It was a bright cold day in April, and the clocks were striking thirteen.” This is my favourite opening sentence in any novel, which you may recognise as being from George Orwell’s 1984, which was published in 1949. This dystopian novel involves a society with mass surveillance, secret police and a political class that manipulates…
Chess is a game that has fascinated AI researchers. Alan Turing wrote a chess algorithm on paper in 1951, though the computers of the time were too slow to run it. In 1957 an IBM engineer called Alex Bernstein wrote a chess program for an IBM 704 computer, which ran on vacuum tubes. As silicon…
While media attention recently has been focused on Anthropic and OpenAI, a new AI announcement from outside Silicon Valley quietly upstaged them on June 22nd. Fugu is a new AI system from a Japanese AI lab called Sakana, built around a large language model and an orchestration layer. On the challenging SWE-Bench Pro benchmark, Sakana…
As enterprises deploy AI, they are discovering the high cost of actually running an AI model, the “inference” costs. Uber spent its way through its 2026 AI budget in four months, with its COO Andrew Macdonald saying: “If you’re not actually able to draw a direct line to how [many] useful features and functionality you’re…
Did a Munich court just open a legal can of worms for AI companies? Traditionally, internet platforms and search providers like Google have been legally insulated from the content that their platforms display. If they provide a link via a search to a website that had defamatory content or obscenities, they are protected in the…
Has the productivity impact of AI gone missing in action? We are now well over three years on from the launch of ChatGPT in November 2022, since when there has been huge investment in AI across the global economy. No less than 61% of all venture capital ($259 billion) went into AI companies in 2025,…
Corporations are investing a fortune in large language models (LLMs) like ChatGPT and Claude based on the promise that they can automate business processes, reduce costs and provide new insights. The reality has proved much trickier than the sales pitch, but just how reliable are these models at basic calculations and logic anyway? A research…
A series of studies have now shown that corporate AI projects are failing at a disturbingly high rate. MIT in August 2025 found that 95% of AI projects fail to deliver any economic return. The same was found at the same 95% failure rate by Boston Consulting Group in September 2025. Similar, albeit slightly lower,…
We are living through an AI paradox. Three years on and hundreds of billions of dollars into the AI boom, the impact on productivity is, according to Goldman Sachs, ‘near zero.’ Yet corporate and VC investment in AI has never been higher. ChatGPT was released in November 2022, and generative AI has become a buzzword.…