Add a listing
    0
    Add a listing

    Tag: Program Synthesis

    Sep 20
    17 min read
    ARC-AGI as a Fluid Intelligence Metric: Testing Agent Adaptation to Out-of-Distribution Abstract Puzzles

    In the early eras of machine learning and large language model development, capability evaluations leaned heavily on knowledge volume. Systems were assessed on multiple-choice standardized exams, reading comprehension passages, bar examinations, medical licensing tests, and vast repositories of open-source programming problems. High scores were interpreted as general reasoning prowess. As training runs expanded to ingest […]