# livecodebench - domain: swe - n_tasks: 100 - n_runnable: 0 - owner_org: LiveCodeBench team (UC Berkeley/MIT/Cornell) - grading: tests - task_kind: contamination-free competitive programming problems - url_repo: https://github.com/LiveCodeBench/LiveCodeBench - url_paper: https://arxiv.org/abs/2403.07974 ## Tasks | task | difficulty | language | runnable | harnesses tried | |---|---|---|---|---| | [1873_d](https://harnessreport.com/tasks/livecodebench/1873_d.md) | | | | 0 | | [2808](https://harnessreport.com/tasks/livecodebench/2808.md) | | | | 0 | | [2848](https://harnessreport.com/tasks/livecodebench/2848.md) | | | | 0 | | [2850](https://harnessreport.com/tasks/livecodebench/2850.md) | | | | 0 | | [2857](https://harnessreport.com/tasks/livecodebench/2857.md) | | | | 0 | | [2954](https://harnessreport.com/tasks/livecodebench/2954.md) | | | | 0 | | [2955](https://harnessreport.com/tasks/livecodebench/2955.md) | | | | 0 | | [3034](https://harnessreport.com/tasks/livecodebench/3034.md) | | | | 0 | | [3046](https://harnessreport.com/tasks/livecodebench/3046.md) | | | | 0 | | [3163](https://harnessreport.com/tasks/livecodebench/3163.md) | | | | 0 | | [3193](https://harnessreport.com/tasks/livecodebench/3193.md) | | | | 0 | | [3194](https://harnessreport.com/tasks/livecodebench/3194.md) | | | | 0 | | [3195](https://harnessreport.com/tasks/livecodebench/3195.md) | | | | 0 | | [3199](https://harnessreport.com/tasks/livecodebench/3199.md) | | | | 0 | | [3206](https://harnessreport.com/tasks/livecodebench/3206.md) | | | | 0 | | [3229](https://harnessreport.com/tasks/livecodebench/3229.md) | | | | 0 | | [3265](https://harnessreport.com/tasks/livecodebench/3265.md) | | | | 0 | | [3299](https://harnessreport.com/tasks/livecodebench/3299.md) | | | | 0 | | [3308](https://harnessreport.com/tasks/livecodebench/3308.md) | | | | 0 | | [3320](https://harnessreport.com/tasks/livecodebench/3320.md) | | | | 0 | | [3353](https://harnessreport.com/tasks/livecodebench/3353.md) | | | | 0 | | [3360](https://harnessreport.com/tasks/livecodebench/3360.md) | | | | 0 | | [3387](https://harnessreport.com/tasks/livecodebench/3387.md) | | | | 0 | | [3406](https://harnessreport.com/tasks/livecodebench/3406.md) | | | | 0 | | [3438](https://harnessreport.com/tasks/livecodebench/3438.md) | | | | 0 | | [3450](https://harnessreport.com/tasks/livecodebench/3450.md) | | | | 0 | | [3455](https://harnessreport.com/tasks/livecodebench/3455.md) | | | | 0 | | [3468](https://harnessreport.com/tasks/livecodebench/3468.md) | | | | 0 | | [3508](https://harnessreport.com/tasks/livecodebench/3508.md) | | | | 0 | | [3518](https://harnessreport.com/tasks/livecodebench/3518.md) | | | | 0 | | [3535](https://harnessreport.com/tasks/livecodebench/3535.md) | | | | 0 | | [3553](https://harnessreport.com/tasks/livecodebench/3553.md) | | | | 0 | | [3608](https://harnessreport.com/tasks/livecodebench/3608.md) | | | | 0 | | [3637](https://harnessreport.com/tasks/livecodebench/3637.md) | | | | 0 | | [3653](https://harnessreport.com/tasks/livecodebench/3653.md) | | | | 0 | | [3655](https://harnessreport.com/tasks/livecodebench/3655.md) | | | | 0 | | [3656](https://harnessreport.com/tasks/livecodebench/3656.md) | | | | 0 | | [3675](https://harnessreport.com/tasks/livecodebench/3675.md) | | | | 0 | | [3676](https://harnessreport.com/tasks/livecodebench/3676.md) | | | | 0 | | [3696](https://harnessreport.com/tasks/livecodebench/3696.md) | | | | 0 | | [3736](https://harnessreport.com/tasks/livecodebench/3736.md) | | | | 0 | | [3763](https://harnessreport.com/tasks/livecodebench/3763.md) | | | | 0 | | [3765](https://harnessreport.com/tasks/livecodebench/3765.md) | | | | 0 | | [3768](https://harnessreport.com/tasks/livecodebench/3768.md) | | | | 0 | | [3779](https://harnessreport.com/tasks/livecodebench/3779.md) | | | | 0 | | [3811](https://harnessreport.com/tasks/livecodebench/3811.md) | | | | 0 | | [abc301_f](https://harnessreport.com/tasks/livecodebench/abc301_f.md) | | | | 0 | | [abc306_d](https://harnessreport.com/tasks/livecodebench/abc306_d.md) | | | | 0 | | [abc307_a](https://harnessreport.com/tasks/livecodebench/abc307_a.md) | | | | 0 | | [abc308_f](https://harnessreport.com/tasks/livecodebench/abc308_f.md) | | | | 0 | | [abc309_d](https://harnessreport.com/tasks/livecodebench/abc309_d.md) | | | | 0 | | [abc310_b](https://harnessreport.com/tasks/livecodebench/abc310_b.md) | | | | 0 | | [abc310_f](https://harnessreport.com/tasks/livecodebench/abc310_f.md) | | | | 0 | | [abc312_d](https://harnessreport.com/tasks/livecodebench/abc312_d.md) | | | | 0 | | [abc312_e](https://harnessreport.com/tasks/livecodebench/abc312_e.md) | | | | 0 | | [abc320_c](https://harnessreport.com/tasks/livecodebench/abc320_c.md) | | | | 0 | | [abc323_d](https://harnessreport.com/tasks/livecodebench/abc323_d.md) | | | | 0 | | [abc325_c](https://harnessreport.com/tasks/livecodebench/abc325_c.md) | | | | 0 | | [abc326_e](https://harnessreport.com/tasks/livecodebench/abc326_e.md) | | | | 0 | | [abc328_d](https://harnessreport.com/tasks/livecodebench/abc328_d.md) | | | | 0 | | [abc329_c](https://harnessreport.com/tasks/livecodebench/abc329_c.md) | | | | 0 | | [abc329_f](https://harnessreport.com/tasks/livecodebench/abc329_f.md) | | | | 0 | | [abc330_c](https://harnessreport.com/tasks/livecodebench/abc330_c.md) | | | | 0 | | [abc330_e](https://harnessreport.com/tasks/livecodebench/abc330_e.md) | | | | 0 | | [abc333_a](https://harnessreport.com/tasks/livecodebench/abc333_a.md) | | | | 0 | | [abc334_b](https://harnessreport.com/tasks/livecodebench/abc334_b.md) | | | | 0 | | [abc334_d](https://harnessreport.com/tasks/livecodebench/abc334_d.md) | | | | 0 | | [abc337_d](https://harnessreport.com/tasks/livecodebench/abc337_d.md) | | | | 0 | | [abc341_e](https://harnessreport.com/tasks/livecodebench/abc341_e.md) | | | | 0 | | [abc343_a](https://harnessreport.com/tasks/livecodebench/abc343_a.md) | | | | 0 | | [abc348_d](https://harnessreport.com/tasks/livecodebench/abc348_d.md) | | | | 0 | | [abc351_e](https://harnessreport.com/tasks/livecodebench/abc351_e.md) | | | | 0 | | [abc351_f](https://harnessreport.com/tasks/livecodebench/abc351_f.md) | | | | 0 | | [abc354_b](https://harnessreport.com/tasks/livecodebench/abc354_b.md) | | | | 0 | | [abc355_c](https://harnessreport.com/tasks/livecodebench/abc355_c.md) | | | | 0 | | [abc356_e](https://harnessreport.com/tasks/livecodebench/abc356_e.md) | | | | 0 | | [abc363_a](https://harnessreport.com/tasks/livecodebench/abc363_a.md) | | | | 0 | | [abc363_e](https://harnessreport.com/tasks/livecodebench/abc363_e.md) | | | | 0 | | [abc363_f](https://harnessreport.com/tasks/livecodebench/abc363_f.md) | | | | 0 | | [abc364_c](https://harnessreport.com/tasks/livecodebench/abc364_c.md) | | | | 0 | | [abc369_a](https://harnessreport.com/tasks/livecodebench/abc369_a.md) | | | | 0 | | [abc377_g](https://harnessreport.com/tasks/livecodebench/abc377_g.md) | | | | 0 | | [abc382_c](https://harnessreport.com/tasks/livecodebench/abc382_c.md) | | | | 0 | | [abc383_d](https://harnessreport.com/tasks/livecodebench/abc383_d.md) | | | | 0 | | [abc384_b](https://harnessreport.com/tasks/livecodebench/abc384_b.md) | | | | 0 | | [abc384_f](https://harnessreport.com/tasks/livecodebench/abc384_f.md) | | | | 0 | | [abc388_g](https://harnessreport.com/tasks/livecodebench/abc388_g.md) | | | | 0 | | [abc389_g](https://harnessreport.com/tasks/livecodebench/abc389_g.md) | | | | 0 | | [abc395_a](https://harnessreport.com/tasks/livecodebench/abc395_a.md) | | | | 0 | | [abc397_d](https://harnessreport.com/tasks/livecodebench/abc397_d.md) | | | | 0 | | [abc399_d](https://harnessreport.com/tasks/livecodebench/abc399_d.md) | | | | 0 | | [arc182_e](https://harnessreport.com/tasks/livecodebench/arc182_e.md) | | | | 0 | | [arc184_d](https://harnessreport.com/tasks/livecodebench/arc184_d.md) | | | | 0 | | [arc186_d](https://harnessreport.com/tasks/livecodebench/arc186_d.md) | | | | 0 | | [arc188_c](https://harnessreport.com/tasks/livecodebench/arc188_c.md) | | | | 0 | | [arc189_b](https://harnessreport.com/tasks/livecodebench/arc189_b.md) | | | | 0 | | [arc192_b](https://harnessreport.com/tasks/livecodebench/arc192_b.md) | | | | 0 | | [arc195_c](https://harnessreport.com/tasks/livecodebench/arc195_c.md) | | | | 0 | | [arc196_a](https://harnessreport.com/tasks/livecodebench/arc196_a.md) | | | | 0 | | [arc196_c](https://harnessreport.com/tasks/livecodebench/arc196_c.md) | | | | 0 | --- Harness Report runs agent harnesses from their GitHub repos on Harbor tasks and records every model call. Every page is also `.md` and `.json`; index: https://harnessreport.com/llms.txt ยท MCP: https://harnessreport.com/mcp