# arc_agi_2 - domain: reasoning-knowledge - n_tasks: 167 - n_runnable: 0 - owner_org: ARC Prize Foundation - grading: exact-match - task_kind: abstract grid-puzzle induction - url_repo: https://github.com/arcprize/ARC-AGI-2 - url_paper: https://arxiv.org/abs/2505.11831 ## Tasks | task | difficulty | language | runnable | harnesses tried | |---|---|---|---|---| | [0934a4d8_0](https://harnessreport.com/tasks/arc_agi_2/0934a4d8_0.md) | hard | | | 0 | | [135a2760_0](https://harnessreport.com/tasks/arc_agi_2/135a2760_0.md) | hard | | | 0 | | [136b0064_0](https://harnessreport.com/tasks/arc_agi_2/136b0064_0.md) | hard | | | 0 | | [13e47133_0](https://harnessreport.com/tasks/arc_agi_2/13e47133_0.md) | hard | | | 0 | | [13e47133_1](https://harnessreport.com/tasks/arc_agi_2/13e47133_1.md) | hard | | | 0 | | [142ca369_0](https://harnessreport.com/tasks/arc_agi_2/142ca369_0.md) | hard | | | 0 | | [142ca369_1](https://harnessreport.com/tasks/arc_agi_2/142ca369_1.md) | hard | | | 0 | | [16b78196_0](https://harnessreport.com/tasks/arc_agi_2/16b78196_0.md) | hard | | | 0 | | [16de56c4_0](https://harnessreport.com/tasks/arc_agi_2/16de56c4_0.md) | hard | | | 0 | | [16de56c4_1](https://harnessreport.com/tasks/arc_agi_2/16de56c4_1.md) | hard | | | 0 | | [1818057f_0](https://harnessreport.com/tasks/arc_agi_2/1818057f_0.md) | hard | | | 0 | | [195c6913_0](https://harnessreport.com/tasks/arc_agi_2/195c6913_0.md) | hard | | | 0 | | [195c6913_1](https://harnessreport.com/tasks/arc_agi_2/195c6913_1.md) | hard | | | 0 | | [1ae2feb7_0](https://harnessreport.com/tasks/arc_agi_2/1ae2feb7_0.md) | hard | | | 0 | | [1ae2feb7_1](https://harnessreport.com/tasks/arc_agi_2/1ae2feb7_1.md) | hard | | | 0 | | [1ae2feb7_2](https://harnessreport.com/tasks/arc_agi_2/1ae2feb7_2.md) | hard | | | 0 | | [20270e3b_0](https://harnessreport.com/tasks/arc_agi_2/20270e3b_0.md) | hard | | | 0 | | [20270e3b_1](https://harnessreport.com/tasks/arc_agi_2/20270e3b_1.md) | hard | | | 0 | | [20a9e565_0](https://harnessreport.com/tasks/arc_agi_2/20a9e565_0.md) | hard | | | 0 | | [20a9e565_1](https://harnessreport.com/tasks/arc_agi_2/20a9e565_1.md) | hard | | | 0 | | [21897d95_0](https://harnessreport.com/tasks/arc_agi_2/21897d95_0.md) | hard | | | 0 | | [21897d95_1](https://harnessreport.com/tasks/arc_agi_2/21897d95_1.md) | hard | | | 0 | | [221dfab4_0](https://harnessreport.com/tasks/arc_agi_2/221dfab4_0.md) | hard | | | 0 | | [221dfab4_1](https://harnessreport.com/tasks/arc_agi_2/221dfab4_1.md) | hard | | | 0 | | [247ef758_0](https://harnessreport.com/tasks/arc_agi_2/247ef758_0.md) | hard | | | 0 | | [247ef758_1](https://harnessreport.com/tasks/arc_agi_2/247ef758_1.md) | hard | | | 0 | | [269e22fb_0](https://harnessreport.com/tasks/arc_agi_2/269e22fb_0.md) | hard | | | 0 | | [269e22fb_1](https://harnessreport.com/tasks/arc_agi_2/269e22fb_1.md) | hard | | | 0 | | [271d71e2_0](https://harnessreport.com/tasks/arc_agi_2/271d71e2_0.md) | hard | | | 0 | | [28a6681f_0](https://harnessreport.com/tasks/arc_agi_2/28a6681f_0.md) | hard | | | 0 | | [291dc1e1_0](https://harnessreport.com/tasks/arc_agi_2/291dc1e1_0.md) | hard | | | 0 | | [2b83f449_0](https://harnessreport.com/tasks/arc_agi_2/2b83f449_0.md) | hard | | | 0 | | [2ba387bc_0](https://harnessreport.com/tasks/arc_agi_2/2ba387bc_0.md) | hard | | | 0 | | [2c181942_0](https://harnessreport.com/tasks/arc_agi_2/2c181942_0.md) | hard | | | 0 | | [2d0172a1_0](https://harnessreport.com/tasks/arc_agi_2/2d0172a1_0.md) | hard | | | 0 | | [2d0172a1_1](https://harnessreport.com/tasks/arc_agi_2/2d0172a1_1.md) | hard | | | 0 | | [31f7f899_0](https://harnessreport.com/tasks/arc_agi_2/31f7f899_0.md) | hard | | | 0 | | [332f06d7_0](https://harnessreport.com/tasks/arc_agi_2/332f06d7_0.md) | hard | | | 0 | | [35ab12c3_0](https://harnessreport.com/tasks/arc_agi_2/35ab12c3_0.md) | hard | | | 0 | | [36a08778_0](https://harnessreport.com/tasks/arc_agi_2/36a08778_0.md) | hard | | | 0 | | [36a08778_1](https://harnessreport.com/tasks/arc_agi_2/36a08778_1.md) | hard | | | 0 | | [38007db0_0](https://harnessreport.com/tasks/arc_agi_2/38007db0_0.md) | hard | | | 0 | | [38007db0_1](https://harnessreport.com/tasks/arc_agi_2/38007db0_1.md) | hard | | | 0 | | [3a25b0d8_0](https://harnessreport.com/tasks/arc_agi_2/3a25b0d8_0.md) | hard | | | 0 | | [3a25b0d8_1](https://harnessreport.com/tasks/arc_agi_2/3a25b0d8_1.md) | hard | | | 0 | | [3dc255db_0](https://harnessreport.com/tasks/arc_agi_2/3dc255db_0.md) | hard | | | 0 | | [3e6067c3_0](https://harnessreport.com/tasks/arc_agi_2/3e6067c3_0.md) | hard | | | 0 | | [3e6067c3_1](https://harnessreport.com/tasks/arc_agi_2/3e6067c3_1.md) | hard | | | 0 | | [409aa875_0](https://harnessreport.com/tasks/arc_agi_2/409aa875_0.md) | hard | | | 0 | | [446ef5d2_0](https://harnessreport.com/tasks/arc_agi_2/446ef5d2_0.md) | hard | | | 0 | | [446ef5d2_1](https://harnessreport.com/tasks/arc_agi_2/446ef5d2_1.md) | hard | | | 0 | | [45a5af55_0](https://harnessreport.com/tasks/arc_agi_2/45a5af55_0.md) | hard | | | 0 | | [4a21e3da_0](https://harnessreport.com/tasks/arc_agi_2/4a21e3da_0.md) | hard | | | 0 | | [4c3d4a41_0](https://harnessreport.com/tasks/arc_agi_2/4c3d4a41_0.md) | hard | | | 0 | | [4c3d4a41_1](https://harnessreport.com/tasks/arc_agi_2/4c3d4a41_1.md) | hard | | | 0 | | [4c416de3_0](https://harnessreport.com/tasks/arc_agi_2/4c416de3_0.md) | hard | | | 0 | | [4c7dc4dd_0](https://harnessreport.com/tasks/arc_agi_2/4c7dc4dd_0.md) | hard | | | 0 | | [4c7dc4dd_1](https://harnessreport.com/tasks/arc_agi_2/4c7dc4dd_1.md) | hard | | | 0 | | [4e34c42c_0](https://harnessreport.com/tasks/arc_agi_2/4e34c42c_0.md) | hard | | | 0 | | [4e34c42c_1](https://harnessreport.com/tasks/arc_agi_2/4e34c42c_1.md) | hard | | | 0 | | [53fb4810_0](https://harnessreport.com/tasks/arc_agi_2/53fb4810_0.md) | hard | | | 0 | | [5545f144_0](https://harnessreport.com/tasks/arc_agi_2/5545f144_0.md) | hard | | | 0 | | [581f7754_0](https://harnessreport.com/tasks/arc_agi_2/581f7754_0.md) | hard | | | 0 | | [581f7754_1](https://harnessreport.com/tasks/arc_agi_2/581f7754_1.md) | hard | | | 0 | | [58490d8a_0](https://harnessreport.com/tasks/arc_agi_2/58490d8a_0.md) | hard | | | 0 | | [58f5dbd5_0](https://harnessreport.com/tasks/arc_agi_2/58f5dbd5_0.md) | hard | | | 0 | | [5961cc34_0](https://harnessreport.com/tasks/arc_agi_2/5961cc34_0.md) | hard | | | 0 | | [5dbc8537_0](https://harnessreport.com/tasks/arc_agi_2/5dbc8537_0.md) | hard | | | 0 | | [5dbc8537_1](https://harnessreport.com/tasks/arc_agi_2/5dbc8537_1.md) | hard | | | 0 | | [62593bfd_0](https://harnessreport.com/tasks/arc_agi_2/62593bfd_0.md) | hard | | | 0 | | [62593bfd_1](https://harnessreport.com/tasks/arc_agi_2/62593bfd_1.md) | hard | | | 0 | | [64efde09_0](https://harnessreport.com/tasks/arc_agi_2/64efde09_0.md) | hard | | | 0 | | [65b59efc_0](https://harnessreport.com/tasks/arc_agi_2/65b59efc_0.md) | hard | | | 0 | | [65b59efc_1](https://harnessreport.com/tasks/arc_agi_2/65b59efc_1.md) | hard | | | 0 | | [67e490f4_0](https://harnessreport.com/tasks/arc_agi_2/67e490f4_0.md) | hard | | | 0 | | [6e453dd6_0](https://harnessreport.com/tasks/arc_agi_2/6e453dd6_0.md) | hard | | | 0 | | [6e4f6532_0](https://harnessreport.com/tasks/arc_agi_2/6e4f6532_0.md) | hard | | | 0 | | [6e4f6532_1](https://harnessreport.com/tasks/arc_agi_2/6e4f6532_1.md) | hard | | | 0 | | [6ffbe589_0](https://harnessreport.com/tasks/arc_agi_2/6ffbe589_0.md) | hard | | | 0 | | [71e489b6_0](https://harnessreport.com/tasks/arc_agi_2/71e489b6_0.md) | hard | | | 0 | | [71e489b6_1](https://harnessreport.com/tasks/arc_agi_2/71e489b6_1.md) | hard | | | 0 | | [7491f3cf_0](https://harnessreport.com/tasks/arc_agi_2/7491f3cf_0.md) | hard | | | 0 | | [7666fa5d_0](https://harnessreport.com/tasks/arc_agi_2/7666fa5d_0.md) | hard | | | 0 | | [78332cb0_0](https://harnessreport.com/tasks/arc_agi_2/78332cb0_0.md) | hard | | | 0 | | [78332cb0_1](https://harnessreport.com/tasks/arc_agi_2/78332cb0_1.md) | hard | | | 0 | | [7b0280bc_0](https://harnessreport.com/tasks/arc_agi_2/7b0280bc_0.md) | hard | | | 0 | | [7b3084d4_0](https://harnessreport.com/tasks/arc_agi_2/7b3084d4_0.md) | hard | | | 0 | | [7b5033c1_0](https://harnessreport.com/tasks/arc_agi_2/7b5033c1_0.md) | hard | | | 0 | | [7b80bb43_0](https://harnessreport.com/tasks/arc_agi_2/7b80bb43_0.md) | hard | | | 0 | | [7c66cb00_0](https://harnessreport.com/tasks/arc_agi_2/7c66cb00_0.md) | hard | | | 0 | | [7ed72f31_0](https://harnessreport.com/tasks/arc_agi_2/7ed72f31_0.md) | hard | | | 0 | | [7ed72f31_1](https://harnessreport.com/tasks/arc_agi_2/7ed72f31_1.md) | hard | | | 0 | | [800d221b_0](https://harnessreport.com/tasks/arc_agi_2/800d221b_0.md) | hard | | | 0 | | [80a900e0_0](https://harnessreport.com/tasks/arc_agi_2/80a900e0_0.md) | hard | | | 0 | | [8698868d_0](https://harnessreport.com/tasks/arc_agi_2/8698868d_0.md) | hard | | | 0 | | [88bcf3b4_0](https://harnessreport.com/tasks/arc_agi_2/88bcf3b4_0.md) | hard | | | 0 | | [88bcf3b4_1](https://harnessreport.com/tasks/arc_agi_2/88bcf3b4_1.md) | hard | | | 0 | | [88e364bc_0](https://harnessreport.com/tasks/arc_agi_2/88e364bc_0.md) | hard | | | 0 | | [88e364bc_1](https://harnessreport.com/tasks/arc_agi_2/88e364bc_1.md) | hard | | | 0 | | [89565ca0_0](https://harnessreport.com/tasks/arc_agi_2/89565ca0_0.md) | hard | | | 0 | | [898e7135_0](https://harnessreport.com/tasks/arc_agi_2/898e7135_0.md) | hard | | | 0 | | [8b7bacbf_0](https://harnessreport.com/tasks/arc_agi_2/8b7bacbf_0.md) | hard | | | 0 | | [8b7bacbf_1](https://harnessreport.com/tasks/arc_agi_2/8b7bacbf_1.md) | hard | | | 0 | | [8b9c3697_0](https://harnessreport.com/tasks/arc_agi_2/8b9c3697_0.md) | hard | | | 0 | | [8e5c0c38_0](https://harnessreport.com/tasks/arc_agi_2/8e5c0c38_0.md) | hard | | | 0 | | [8e5c0c38_1](https://harnessreport.com/tasks/arc_agi_2/8e5c0c38_1.md) | hard | | | 0 | | [8f215267_0](https://harnessreport.com/tasks/arc_agi_2/8f215267_0.md) | hard | | | 0 | | [8f3a5a89_0](https://harnessreport.com/tasks/arc_agi_2/8f3a5a89_0.md) | hard | | | 0 | | [9385bd28_0](https://harnessreport.com/tasks/arc_agi_2/9385bd28_0.md) | hard | | | 0 | | [9385bd28_1](https://harnessreport.com/tasks/arc_agi_2/9385bd28_1.md) | hard | | | 0 | | [97d7923e_0](https://harnessreport.com/tasks/arc_agi_2/97d7923e_0.md) | hard | | | 0 | | [981571dc_0](https://harnessreport.com/tasks/arc_agi_2/981571dc_0.md) | hard | | | 0 | | [9aaea919_0](https://harnessreport.com/tasks/arc_agi_2/9aaea919_0.md) | hard | | | 0 | | [9bbf930d_0](https://harnessreport.com/tasks/arc_agi_2/9bbf930d_0.md) | hard | | | 0 | | [a251c730_0](https://harnessreport.com/tasks/arc_agi_2/a251c730_0.md) | hard | | | 0 | | [a25697e4_0](https://harnessreport.com/tasks/arc_agi_2/a25697e4_0.md) | hard | | | 0 | | [a25697e4_1](https://harnessreport.com/tasks/arc_agi_2/a25697e4_1.md) | hard | | | 0 | | [a32d8b75_0](https://harnessreport.com/tasks/arc_agi_2/a32d8b75_0.md) | hard | | | 0 | | [a32d8b75_1](https://harnessreport.com/tasks/arc_agi_2/a32d8b75_1.md) | hard | | | 0 | | [a395ee82_0](https://harnessreport.com/tasks/arc_agi_2/a395ee82_0.md) | hard | | | 0 | | [a47bf94d_0](https://harnessreport.com/tasks/arc_agi_2/a47bf94d_0.md) | hard | | | 0 | | [a6f40cea_0](https://harnessreport.com/tasks/arc_agi_2/a6f40cea_0.md) | hard | | | 0 | | [aa4ec2a5_0](https://harnessreport.com/tasks/arc_agi_2/aa4ec2a5_0.md) | hard | | | 0 | | [abc82100_0](https://harnessreport.com/tasks/arc_agi_2/abc82100_0.md) | hard | | | 0 | | [b0039139_0](https://harnessreport.com/tasks/arc_agi_2/b0039139_0.md) | hard | | | 0 | | [b0039139_1](https://harnessreport.com/tasks/arc_agi_2/b0039139_1.md) | hard | | | 0 | | [b10624e5_0](https://harnessreport.com/tasks/arc_agi_2/b10624e5_0.md) | hard | | | 0 | | [b5ca7ac4_0](https://harnessreport.com/tasks/arc_agi_2/b5ca7ac4_0.md) | hard | | | 0 | | [b6f77b65_0](https://harnessreport.com/tasks/arc_agi_2/b6f77b65_0.md) | hard | | | 0 | | [b6f77b65_1](https://harnessreport.com/tasks/arc_agi_2/b6f77b65_1.md) | hard | | | 0 | | [b99e7126_0](https://harnessreport.com/tasks/arc_agi_2/b99e7126_0.md) | hard | | | 0 | | [b9e38dc0_0](https://harnessreport.com/tasks/arc_agi_2/b9e38dc0_0.md) | hard | | | 0 | | [bf45cf4b_0](https://harnessreport.com/tasks/arc_agi_2/bf45cf4b_0.md) | hard | | | 0 | | [c4d067a0_0](https://harnessreport.com/tasks/arc_agi_2/c4d067a0_0.md) | hard | | | 0 | | [c7f57c3e_0](https://harnessreport.com/tasks/arc_agi_2/c7f57c3e_0.md) | hard | | | 0 | | [cb2d8a2c_0](https://harnessreport.com/tasks/arc_agi_2/cb2d8a2c_0.md) | hard | | | 0 | | [cb2d8a2c_1](https://harnessreport.com/tasks/arc_agi_2/cb2d8a2c_1.md) | hard | | | 0 | | [cbebaa4b_0](https://harnessreport.com/tasks/arc_agi_2/cbebaa4b_0.md) | hard | | | 0 | | [cbebaa4b_1](https://harnessreport.com/tasks/arc_agi_2/cbebaa4b_1.md) | hard | | | 0 | | [d35bdbdc_0](https://harnessreport.com/tasks/arc_agi_2/d35bdbdc_0.md) | hard | | | 0 | | [d35bdbdc_1](https://harnessreport.com/tasks/arc_agi_2/d35bdbdc_1.md) | hard | | | 0 | | [d35bdbdc_2](https://harnessreport.com/tasks/arc_agi_2/d35bdbdc_2.md) | hard | | | 0 | | [d59b0160_0](https://harnessreport.com/tasks/arc_agi_2/d59b0160_0.md) | hard | | | 0 | | [d8e07eb2_0](https://harnessreport.com/tasks/arc_agi_2/d8e07eb2_0.md) | hard | | | 0 | | [d8e07eb2_1](https://harnessreport.com/tasks/arc_agi_2/d8e07eb2_1.md) | hard | | | 0 | | [da515329_0](https://harnessreport.com/tasks/arc_agi_2/da515329_0.md) | hard | | | 0 | | [db0c5428_0](https://harnessreport.com/tasks/arc_agi_2/db0c5428_0.md) | hard | | | 0 | | [db695cfb_0](https://harnessreport.com/tasks/arc_agi_2/db695cfb_0.md) | hard | | | 0 | | [dbff022c_0](https://harnessreport.com/tasks/arc_agi_2/dbff022c_0.md) | hard | | | 0 | | [dd6b8c4b_0](https://harnessreport.com/tasks/arc_agi_2/dd6b8c4b_0.md) | hard | | | 0 | | [dd6b8c4b_1](https://harnessreport.com/tasks/arc_agi_2/dd6b8c4b_1.md) | hard | | | 0 | | [de809cff_0](https://harnessreport.com/tasks/arc_agi_2/de809cff_0.md) | hard | | | 0 | | [dfadab01_0](https://harnessreport.com/tasks/arc_agi_2/dfadab01_0.md) | hard | | | 0 | | [e12f9a14_0](https://harnessreport.com/tasks/arc_agi_2/e12f9a14_0.md) | hard | | | 0 | | [e12f9a14_1](https://harnessreport.com/tasks/arc_agi_2/e12f9a14_1.md) | hard | | | 0 | | [e3721c99_0](https://harnessreport.com/tasks/arc_agi_2/e3721c99_0.md) | hard | | | 0 | | [e3721c99_1](https://harnessreport.com/tasks/arc_agi_2/e3721c99_1.md) | hard | | | 0 | | [e376de54_0](https://harnessreport.com/tasks/arc_agi_2/e376de54_0.md) | hard | | | 0 | | [e8686506_0](https://harnessreport.com/tasks/arc_agi_2/e8686506_0.md) | hard | | | 0 | | [e87109e9_0](https://harnessreport.com/tasks/arc_agi_2/e87109e9_0.md) | hard | | | 0 | | [edb79dae_0](https://harnessreport.com/tasks/arc_agi_2/edb79dae_0.md) | hard | | | 0 | | [eee78d87_0](https://harnessreport.com/tasks/arc_agi_2/eee78d87_0.md) | hard | | | 0 | | [f560132c_0](https://harnessreport.com/tasks/arc_agi_2/f560132c_0.md) | hard | | | 0 | | [f931b4a8_0](https://harnessreport.com/tasks/arc_agi_2/f931b4a8_0.md) | hard | | | 0 | | [f931b4a8_1](https://harnessreport.com/tasks/arc_agi_2/f931b4a8_1.md) | hard | | | 0 | | [faa9f03d_0](https://harnessreport.com/tasks/arc_agi_2/faa9f03d_0.md) | hard | | | 0 | | [fc7cae8d_0](https://harnessreport.com/tasks/arc_agi_2/fc7cae8d_0.md) | hard | | | 0 | --- Harness Report runs agent harnesses from their GitHub repos on Harbor tasks and records every model call. Every page is also `.md` and `.json`; index: https://harnessreport.com/llms.txt ยท MCP: https://harnessreport.com/mcp