preprint وصول مفتوح

EUT-AGI: Measuring Structural Admissibility Under Uncertainty in Frontier Models

  • Zenodo (CERN European Organization for Nuclear Research)
  • European Organization for Nuclear Research
Research footprint

At a glance

الاستشهادات
0
المراجع
0
Comments
0
Paper overview

Abstract

A benchmark for the failure mode nobody measures: confident AI action taken before the evidence justifies it. We introduce Structural Admissibility as a measurable cognitive property — the capacity to determine whether the current epistemic state justifies committing to an action. Grounded in the Expanding Uncertainty Threshold (EUT) framework, this benchmark evaluates four metacognitive behaviors in frontier language models: instability detection, false resolution resistance, clarification quality, and action gating. Evaluation of 7 frontier models (Claude 3.5 Sonnet, GPT-4o, Gemini 1.5 Pro, Claude 3 Haiku, Gemini 2.0 Flash, Llama 3.1 70B, Mistral Large 2) across 150 benchmark items spanning 5 task families. Human baseline: 42 graduate-level participants. Best model (Claude 3.5 Sonnet) CAS: 0.843 vs human baseline 0.887. Submitted to: Kaggle — Measuring Progress Toward AGI — Cognitive Abilities Hackathon (Metacognition track), March 2026.

Record transparency

Publication details

DOI
10.5281/zenodo.19134947
OpenAlex
W7139944429
Document type
preprint
Language
EN
Source
Zenodo (CERN European Organization for Nuclear Research)
Last metadata update
المجتمع

Comments

تسجيل الدخول للانضمام إلى النقاش.

  1. لا توجد تعليقات بعد. ابدأ النقاش.