Add a listing
    0
    Add a listing

    Tag: InterCode

    Sep 20
    15 min read
    InterCode: Evaluating Interactive Code Execution and Self-Correction Across Bash, Python, and SQL

    In early code generation evaluations, programming capability was treated as a static, single-turn translation problem. Benchmarks like HumanEval, MBPP, and Spider provided a model with a clean natural-language docstring or schema, collected an unbroken script or SQL string in a single forward pass, and tested the output against static unit tests. The evaluation assumed that […]