# acebench-special - domain: enterprise-ops - n_tasks: 150 - n_runnable: 0 - owner_org: Mercor - grading: rubric - task_kind: evaluation criteria for DIY/food/shopping/gaming tasks ## Tasks | task | difficulty | language | runnable | harnesses tried | |---|---|---|---|---| | [ace-bench_special_error_param_0](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_0.md) | medium | | | 0 | | [ace-bench_special_error_param_1](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_1.md) | medium | | | 0 | | [ace-bench_special_error_param_10](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_10.md) | medium | | | 0 | | [ace-bench_special_error_param_11](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_11.md) | medium | | | 0 | | [ace-bench_special_error_param_12](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_12.md) | medium | | | 0 | | [ace-bench_special_error_param_13](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_13.md) | medium | | | 0 | | [ace-bench_special_error_param_14](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_14.md) | medium | | | 0 | | [ace-bench_special_error_param_15](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_15.md) | medium | | | 0 | | [ace-bench_special_error_param_16](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_16.md) | medium | | | 0 | | [ace-bench_special_error_param_17](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_17.md) | medium | | | 0 | | [ace-bench_special_error_param_18](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_18.md) | medium | | | 0 | | [ace-bench_special_error_param_19](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_19.md) | medium | | | 0 | | [ace-bench_special_error_param_2](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_2.md) | medium | | | 0 | | [ace-bench_special_error_param_20](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_20.md) | medium | | | 0 | | [ace-bench_special_error_param_21](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_21.md) | medium | | | 0 | | [ace-bench_special_error_param_22](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_22.md) | medium | | | 0 | | [ace-bench_special_error_param_23](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_23.md) | medium | | | 0 | | [ace-bench_special_error_param_24](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_24.md) | medium | | | 0 | | [ace-bench_special_error_param_25](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_25.md) | medium | | | 0 | | [ace-bench_special_error_param_26](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_26.md) | medium | | | 0 | | [ace-bench_special_error_param_27](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_27.md) | medium | | | 0 | | [ace-bench_special_error_param_28](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_28.md) | medium | | | 0 | | [ace-bench_special_error_param_29](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_29.md) | medium | | | 0 | | [ace-bench_special_error_param_3](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_3.md) | medium | | | 0 | | [ace-bench_special_error_param_30](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_30.md) | medium | | | 0 | | [ace-bench_special_error_param_31](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_31.md) | medium | | | 0 | | [ace-bench_special_error_param_32](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_32.md) | medium | | | 0 | | [ace-bench_special_error_param_33](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_33.md) | medium | | | 0 | | [ace-bench_special_error_param_34](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_34.md) | medium | | | 0 | | [ace-bench_special_error_param_35](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_35.md) | medium | | | 0 | | [ace-bench_special_error_param_36](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_36.md) | medium | | | 0 | | [ace-bench_special_error_param_37](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_37.md) | medium | | | 0 | | [ace-bench_special_error_param_38](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_38.md) | medium | | | 0 | | [ace-bench_special_error_param_39](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_39.md) | medium | | | 0 | | [ace-bench_special_error_param_4](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_4.md) | medium | | | 0 | | [ace-bench_special_error_param_40](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_40.md) | medium | | | 0 | | [ace-bench_special_error_param_41](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_41.md) | medium | | | 0 | | [ace-bench_special_error_param_42](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_42.md) | medium | | | 0 | | [ace-bench_special_error_param_43](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_43.md) | medium | | | 0 | | [ace-bench_special_error_param_44](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_44.md) | medium | | | 0 | | [ace-bench_special_error_param_45](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_45.md) | medium | | | 0 | | [ace-bench_special_error_param_46](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_46.md) | medium | | | 0 | | [ace-bench_special_error_param_47](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_47.md) | medium | | | 0 | | [ace-bench_special_error_param_48](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_48.md) | medium | | | 0 | | [ace-bench_special_error_param_49](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_49.md) | medium | | | 0 | | [ace-bench_special_error_param_5](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_5.md) | medium | | | 0 | | [ace-bench_special_error_param_6](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_6.md) | medium | | | 0 | | [ace-bench_special_error_param_7](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_7.md) | medium | | | 0 | | [ace-bench_special_error_param_8](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_8.md) | medium | | | 0 | | [ace-bench_special_error_param_9](https://harnessreport.com/tasks/acebench-special/ace-bench_special_error_param_9.md) | medium | | | 0 | | [ace-bench_special_incomplete_0](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_0.md) | medium | | | 0 | | [ace-bench_special_incomplete_1](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_1.md) | medium | | | 0 | | [ace-bench_special_incomplete_10](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_10.md) | medium | | | 0 | | [ace-bench_special_incomplete_11](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_11.md) | medium | | | 0 | | [ace-bench_special_incomplete_12](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_12.md) | medium | | | 0 | | [ace-bench_special_incomplete_13](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_13.md) | medium | | | 0 | | [ace-bench_special_incomplete_14](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_14.md) | medium | | | 0 | | [ace-bench_special_incomplete_15](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_15.md) | medium | | | 0 | | [ace-bench_special_incomplete_16](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_16.md) | medium | | | 0 | | [ace-bench_special_incomplete_17](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_17.md) | medium | | | 0 | | [ace-bench_special_incomplete_18](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_18.md) | medium | | | 0 | | [ace-bench_special_incomplete_19](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_19.md) | medium | | | 0 | | [ace-bench_special_incomplete_2](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_2.md) | medium | | | 0 | | [ace-bench_special_incomplete_20](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_20.md) | medium | | | 0 | | [ace-bench_special_incomplete_21](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_21.md) | medium | | | 0 | | [ace-bench_special_incomplete_22](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_22.md) | medium | | | 0 | | [ace-bench_special_incomplete_23](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_23.md) | medium | | | 0 | | [ace-bench_special_incomplete_24](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_24.md) | medium | | | 0 | | [ace-bench_special_incomplete_25](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_25.md) | medium | | | 0 | | [ace-bench_special_incomplete_26](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_26.md) | medium | | | 0 | | [ace-bench_special_incomplete_27](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_27.md) | medium | | | 0 | | [ace-bench_special_incomplete_28](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_28.md) | medium | | | 0 | | [ace-bench_special_incomplete_29](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_29.md) | medium | | | 0 | | [ace-bench_special_incomplete_3](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_3.md) | medium | | | 0 | | [ace-bench_special_incomplete_30](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_30.md) | medium | | | 0 | | [ace-bench_special_incomplete_31](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_31.md) | medium | | | 0 | | [ace-bench_special_incomplete_32](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_32.md) | medium | | | 0 | | [ace-bench_special_incomplete_33](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_33.md) | medium | | | 0 | | [ace-bench_special_incomplete_34](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_34.md) | medium | | | 0 | | [ace-bench_special_incomplete_35](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_35.md) | medium | | | 0 | | [ace-bench_special_incomplete_36](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_36.md) | medium | | | 0 | | [ace-bench_special_incomplete_37](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_37.md) | medium | | | 0 | | [ace-bench_special_incomplete_38](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_38.md) | medium | | | 0 | | [ace-bench_special_incomplete_39](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_39.md) | medium | | | 0 | | [ace-bench_special_incomplete_4](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_4.md) | medium | | | 0 | | [ace-bench_special_incomplete_40](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_40.md) | medium | | | 0 | | [ace-bench_special_incomplete_41](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_41.md) | medium | | | 0 | | [ace-bench_special_incomplete_42](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_42.md) | medium | | | 0 | | [ace-bench_special_incomplete_43](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_43.md) | medium | | | 0 | | [ace-bench_special_incomplete_44](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_44.md) | medium | | | 0 | | [ace-bench_special_incomplete_45](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_45.md) | medium | | | 0 | | [ace-bench_special_incomplete_46](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_46.md) | medium | | | 0 | | [ace-bench_special_incomplete_47](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_47.md) | medium | | | 0 | | [ace-bench_special_incomplete_48](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_48.md) | medium | | | 0 | | [ace-bench_special_incomplete_49](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_49.md) | medium | | | 0 | | [ace-bench_special_incomplete_5](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_5.md) | medium | | | 0 | | [ace-bench_special_incomplete_6](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_6.md) | medium | | | 0 | | [ace-bench_special_incomplete_7](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_7.md) | medium | | | 0 | | [ace-bench_special_incomplete_8](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_8.md) | medium | | | 0 | | [ace-bench_special_incomplete_9](https://harnessreport.com/tasks/acebench-special/ace-bench_special_incomplete_9.md) | medium | | | 0 | | [ace-bench_special_irrelevant_0](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_0.md) | medium | | | 0 | | [ace-bench_special_irrelevant_1](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_1.md) | medium | | | 0 | | [ace-bench_special_irrelevant_10](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_10.md) | medium | | | 0 | | [ace-bench_special_irrelevant_11](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_11.md) | medium | | | 0 | | [ace-bench_special_irrelevant_12](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_12.md) | medium | | | 0 | | [ace-bench_special_irrelevant_13](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_13.md) | medium | | | 0 | | [ace-bench_special_irrelevant_14](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_14.md) | medium | | | 0 | | [ace-bench_special_irrelevant_15](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_15.md) | medium | | | 0 | | [ace-bench_special_irrelevant_16](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_16.md) | medium | | | 0 | | [ace-bench_special_irrelevant_17](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_17.md) | medium | | | 0 | | [ace-bench_special_irrelevant_18](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_18.md) | medium | | | 0 | | [ace-bench_special_irrelevant_19](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_19.md) | medium | | | 0 | | [ace-bench_special_irrelevant_2](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_2.md) | medium | | | 0 | | [ace-bench_special_irrelevant_20](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_20.md) | medium | | | 0 | | [ace-bench_special_irrelevant_21](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_21.md) | medium | | | 0 | | [ace-bench_special_irrelevant_22](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_22.md) | medium | | | 0 | | [ace-bench_special_irrelevant_23](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_23.md) | medium | | | 0 | | [ace-bench_special_irrelevant_24](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_24.md) | medium | | | 0 | | [ace-bench_special_irrelevant_25](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_25.md) | medium | | | 0 | | [ace-bench_special_irrelevant_26](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_26.md) | medium | | | 0 | | [ace-bench_special_irrelevant_27](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_27.md) | medium | | | 0 | | [ace-bench_special_irrelevant_28](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_28.md) | medium | | | 0 | | [ace-bench_special_irrelevant_29](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_29.md) | medium | | | 0 | | [ace-bench_special_irrelevant_3](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_3.md) | medium | | | 0 | | [ace-bench_special_irrelevant_30](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_30.md) | medium | | | 0 | | [ace-bench_special_irrelevant_31](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_31.md) | medium | | | 0 | | [ace-bench_special_irrelevant_32](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_32.md) | medium | | | 0 | | [ace-bench_special_irrelevant_33](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_33.md) | medium | | | 0 | | [ace-bench_special_irrelevant_34](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_34.md) | medium | | | 0 | | [ace-bench_special_irrelevant_35](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_35.md) | medium | | | 0 | | [ace-bench_special_irrelevant_36](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_36.md) | medium | | | 0 | | [ace-bench_special_irrelevant_37](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_37.md) | medium | | | 0 | | [ace-bench_special_irrelevant_38](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_38.md) | medium | | | 0 | | [ace-bench_special_irrelevant_39](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_39.md) | medium | | | 0 | | [ace-bench_special_irrelevant_4](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_4.md) | medium | | | 0 | | [ace-bench_special_irrelevant_40](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_40.md) | medium | | | 0 | | [ace-bench_special_irrelevant_41](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_41.md) | medium | | | 0 | | [ace-bench_special_irrelevant_42](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_42.md) | medium | | | 0 | | [ace-bench_special_irrelevant_43](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_43.md) | medium | | | 0 | | [ace-bench_special_irrelevant_44](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_44.md) | medium | | | 0 | | [ace-bench_special_irrelevant_45](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_45.md) | medium | | | 0 | | [ace-bench_special_irrelevant_46](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_46.md) | medium | | | 0 | | [ace-bench_special_irrelevant_47](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_47.md) | medium | | | 0 | | [ace-bench_special_irrelevant_48](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_48.md) | medium | | | 0 | | [ace-bench_special_irrelevant_49](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_49.md) | medium | | | 0 | | [ace-bench_special_irrelevant_5](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_5.md) | medium | | | 0 | | [ace-bench_special_irrelevant_6](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_6.md) | medium | | | 0 | | [ace-bench_special_irrelevant_7](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_7.md) | medium | | | 0 | | [ace-bench_special_irrelevant_8](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_8.md) | medium | | | 0 | | [ace-bench_special_irrelevant_9](https://harnessreport.com/tasks/acebench-special/ace-bench_special_irrelevant_9.md) | medium | | | 0 | --- Harness Report runs agent harnesses from their GitHub repos on Harbor tasks and records every model call. Every page is also `.md` and `.json`; index: https://harnessreport.com/llms.txt · MCP: https://harnessreport.com/mcp