MicroEvals
Public evaluations
Showing 5761-5780 of 10167




I REALLY WANTED TO HAVE A COMPARISON FIGHT BETWEEN THE 5 BEST MODELS IN MY SIGHT AVAILABLE FOR PROGRAMMING RELATED TASKS
اي شيء
A hard, original agentic coding task. Models must implement a spreadsheet engine from a precise written spec: a recursive-descent formula parser, integer arithmetic with truncating division, lazy IF, row-major error ordering in range aggregates, static cycle detection that ignores IF laziness, and UNDO. The spec also lists six performance families (deep chains, 100k-cell ranges with point updates, cycle toggling, wide rectangles, 10k-character nested formulas) that naive solutions fail. Outputs are deterministic stdin/stdout, so each submission can be scored objectively by running it against the public example and hidden tests.









