GAUGE benchmark evaluates whether frontier AI models recognise uncertainty and act on it responsibly
LONDON, UNITED KINGDOM, July 17, 2026
Eros Innovation today announced that Eros GenAI researchers Arjun Thilak R. and Ramkumar M. V. have been named among the four Grand Prize winners of the Google DeepMind × Kaggle “Measuring Progress Toward AGI: Cognitive Abilities” Hackathon.
Their winning benchmark, GAUGE: Measuring the Gap Between What LLMs Know and What They Do About It, introduces a multi-turn evaluation protocol designed to assess whether large language models not only recognise uncertainty but also respond appropriately by abstaining when an answer may be unreliable.
The benchmark addresses a critical limitation in current AI systems: a model may accurately express uncertainty yet continue to act with unjustified confidence. In high-stakes environments such as government, education, healthcare, and enterprise systems, the ability to abstain and escalate a decision to a human operator can be as important as raw model accuracy.
Both organisations share a commitment to purpose-driven innovation, using technology, data and creativity to accelerate progress across electrification, sustainability and cultural integrity. Eros and Envision will look to host events that showcase the very latest in sustainable technologies, helping to expand on Envision Racing’s highly respected Race Against Climate Change™ Summits. With Eros’s heritage in producing world-class content and its related AI capabilities, the companies will explore how to bring to life the world of sustainable electric racing through the production of inspirational content.
Eros Innovation intends to explore the integration of the GAUGE methodology into its broader model evaluation and AI assurance framework, supporting the assessment of global, open-weight, and Eros-developed models across reliability, uncertainty, safety, and human-escalation behaviour.
The company also plans to extend this research into Cultural Intelligence, rights-aware AI, education, citizen services, and other sovereign AI applications.
The achievement supports Eros Innovation’s broader ambition to build a global Sovereign Cultural Intelligence platform that combines advanced model orchestration, Cultural AI, rights and identity infrastructure, trustworthy agents, and country-specific intelligence systems.
At the core of the platform is the Eros Large Cultural Model (LCM) family, including Eros LCM-Vision, Eros LCVM-Voice, and Eros LCMM-Music, developed in collaboration with the Indian Institute of Technology Madras. Unlike conventional large language models trained primarily on publicly available internet data, the Eros models are built on a proprietary corpus of approximately 1.5 trillion rights-cleared, ethically sourced cultural tokens, derived from more than 11,000 films, 100,000 characters, music, dialogue, mythology, and cultural knowledge accumulated over four decades. The corpus has been independently valued at US$1.7 billion by OxValue.AI, a University of Oxford spin-out.
The Eros AI platform powers a portfolio of businesses including Eros Universe, Eros Brahmand, Eros AI Vidya, Eros Music World, Eros Wellness, Eros Experiences, and sovereign AI solutions for governments and enterprises. Built on a common AI infrastructure stack, these platforms enable the creation, protection, monetisation, and responsible deployment of cultural and domain-specific intelligence at scale.
Eros Innovation’s mission is to become the world’s trusted Cultural Intelligence Infrastructure—building sovereign, ethical AI systems that preserve, enhance, and responsibly commercialise culture while advancing innovation across education, healthcare, tourism, media, digital identity, and strategic national infrastructure.
