Exploring the power and pitfalls of Artificial Intelligence.

A podium at an AI competition, with several sleek but visually distinct humanoid robots representing rival AI models. Instead of a single finishing line, they are being judged on a confusing array of different tests: intelligence, accuracy, hallucination rate, reasoning, agentic ability, speed and cost.

Lies, Damned Lies, and AI Benchmarks

The AA Omniscience benchmark of AI knowledge and hallucination was created by Artificial Analysis, an independent, venture-backed benchmarking company based in San Francisco. Originally launched in November 2025, this comprehensive benchmark covers 6,000 questions across six major domains (business, law, health, software, science and the humanities). Artificial Analysis published its quarterly update on October 1st…