# scienceagentbench - domain: science-math - n_tasks: 102 - n_runnable: 0 - owner_org: OSU NLP - grading: tests - task_kind: data-driven scientific discovery programs - url_repo: https://github.com/OSU-NLP-Group/ScienceAgentBench - url_paper: https://arxiv.org/abs/2410.05080 ## Tasks | task | difficulty | language | runnable | harnesses tried | |---|---|---|---|---| | [sab_1](https://harnessreport.com/tasks/scienceagentbench/sab_1.md) | hard | | | 0 | | [sab_10](https://harnessreport.com/tasks/scienceagentbench/sab_10.md) | medium | | | 0 | | [sab_100](https://harnessreport.com/tasks/scienceagentbench/sab_100.md) | medium | | | 0 | | [sab_101](https://harnessreport.com/tasks/scienceagentbench/sab_101.md) | hard | | | 0 | | [sab_102](https://harnessreport.com/tasks/scienceagentbench/sab_102.md) | hard | | | 0 | | [sab_11](https://harnessreport.com/tasks/scienceagentbench/sab_11.md) | hard | | | 0 | | [sab_12](https://harnessreport.com/tasks/scienceagentbench/sab_12.md) | hard | | | 0 | | [sab_13](https://harnessreport.com/tasks/scienceagentbench/sab_13.md) | hard | | | 0 | | [sab_14](https://harnessreport.com/tasks/scienceagentbench/sab_14.md) | medium | | | 0 | | [sab_15](https://harnessreport.com/tasks/scienceagentbench/sab_15.md) | hard | | | 0 | | [sab_16](https://harnessreport.com/tasks/scienceagentbench/sab_16.md) | medium | | | 0 | | [sab_17](https://harnessreport.com/tasks/scienceagentbench/sab_17.md) | medium | | | 0 | | [sab_18](https://harnessreport.com/tasks/scienceagentbench/sab_18.md) | hard | | | 0 | | [sab_19](https://harnessreport.com/tasks/scienceagentbench/sab_19.md) | hard | | | 0 | | [sab_2](https://harnessreport.com/tasks/scienceagentbench/sab_2.md) | hard | | | 0 | | [sab_20](https://harnessreport.com/tasks/scienceagentbench/sab_20.md) | medium | | | 0 | | [sab_21](https://harnessreport.com/tasks/scienceagentbench/sab_21.md) | medium | | | 0 | | [sab_22](https://harnessreport.com/tasks/scienceagentbench/sab_22.md) | medium | | | 0 | | [sab_23](https://harnessreport.com/tasks/scienceagentbench/sab_23.md) | medium | | | 0 | | [sab_24](https://harnessreport.com/tasks/scienceagentbench/sab_24.md) | medium | | | 0 | | [sab_25](https://harnessreport.com/tasks/scienceagentbench/sab_25.md) | medium | | | 0 | | [sab_26](https://harnessreport.com/tasks/scienceagentbench/sab_26.md) | medium | | | 0 | | [sab_27](https://harnessreport.com/tasks/scienceagentbench/sab_27.md) | medium | | | 0 | | [sab_28](https://harnessreport.com/tasks/scienceagentbench/sab_28.md) | medium | | | 0 | | [sab_29](https://harnessreport.com/tasks/scienceagentbench/sab_29.md) | medium | | | 0 | | [sab_3](https://harnessreport.com/tasks/scienceagentbench/sab_3.md) | hard | | | 0 | | [sab_30](https://harnessreport.com/tasks/scienceagentbench/sab_30.md) | medium | | | 0 | | [sab_31](https://harnessreport.com/tasks/scienceagentbench/sab_31.md) | medium | | | 0 | | [sab_32](https://harnessreport.com/tasks/scienceagentbench/sab_32.md) | medium | | | 0 | | [sab_33](https://harnessreport.com/tasks/scienceagentbench/sab_33.md) | medium | | | 0 | | [sab_34](https://harnessreport.com/tasks/scienceagentbench/sab_34.md) | medium | | | 0 | | [sab_35](https://harnessreport.com/tasks/scienceagentbench/sab_35.md) | medium | | | 0 | | [sab_36](https://harnessreport.com/tasks/scienceagentbench/sab_36.md) | medium | | | 0 | | [sab_37](https://harnessreport.com/tasks/scienceagentbench/sab_37.md) | medium | | | 0 | | [sab_38](https://harnessreport.com/tasks/scienceagentbench/sab_38.md) | medium | | | 0 | | [sab_39](https://harnessreport.com/tasks/scienceagentbench/sab_39.md) | medium | | | 0 | | [sab_4](https://harnessreport.com/tasks/scienceagentbench/sab_4.md) | medium | | | 0 | | [sab_40](https://harnessreport.com/tasks/scienceagentbench/sab_40.md) | hard | | | 0 | | [sab_41](https://harnessreport.com/tasks/scienceagentbench/sab_41.md) | hard | | | 0 | | [sab_42](https://harnessreport.com/tasks/scienceagentbench/sab_42.md) | medium | | | 0 | | [sab_43](https://harnessreport.com/tasks/scienceagentbench/sab_43.md) | medium | | | 0 | | [sab_44](https://harnessreport.com/tasks/scienceagentbench/sab_44.md) | medium | | | 0 | | [sab_45](https://harnessreport.com/tasks/scienceagentbench/sab_45.md) | medium | | | 0 | | [sab_46](https://harnessreport.com/tasks/scienceagentbench/sab_46.md) | medium | | | 0 | | [sab_47](https://harnessreport.com/tasks/scienceagentbench/sab_47.md) | medium | | | 0 | | [sab_48](https://harnessreport.com/tasks/scienceagentbench/sab_48.md) | medium | | | 0 | | [sab_49](https://harnessreport.com/tasks/scienceagentbench/sab_49.md) | medium | | | 0 | | [sab_5](https://harnessreport.com/tasks/scienceagentbench/sab_5.md) | medium | | | 0 | | [sab_50](https://harnessreport.com/tasks/scienceagentbench/sab_50.md) | medium | | | 0 | | [sab_51](https://harnessreport.com/tasks/scienceagentbench/sab_51.md) | hard | | | 0 | | [sab_52](https://harnessreport.com/tasks/scienceagentbench/sab_52.md) | hard | | | 0 | | [sab_53](https://harnessreport.com/tasks/scienceagentbench/sab_53.md) | medium | | | 0 | | [sab_54](https://harnessreport.com/tasks/scienceagentbench/sab_54.md) | medium | | | 0 | | [sab_55](https://harnessreport.com/tasks/scienceagentbench/sab_55.md) | medium | | | 0 | | [sab_56](https://harnessreport.com/tasks/scienceagentbench/sab_56.md) | medium | | | 0 | | [sab_57](https://harnessreport.com/tasks/scienceagentbench/sab_57.md) | medium | | | 0 | | [sab_58](https://harnessreport.com/tasks/scienceagentbench/sab_58.md) | medium | | | 0 | | [sab_59](https://harnessreport.com/tasks/scienceagentbench/sab_59.md) | medium | | | 0 | | [sab_6](https://harnessreport.com/tasks/scienceagentbench/sab_6.md) | medium | | | 0 | | [sab_60](https://harnessreport.com/tasks/scienceagentbench/sab_60.md) | medium | | | 0 | | [sab_61](https://harnessreport.com/tasks/scienceagentbench/sab_61.md) | medium | | | 0 | | [sab_62](https://harnessreport.com/tasks/scienceagentbench/sab_62.md) | medium | | | 0 | | [sab_63](https://harnessreport.com/tasks/scienceagentbench/sab_63.md) | medium | | | 0 | | [sab_64](https://harnessreport.com/tasks/scienceagentbench/sab_64.md) | medium | | | 0 | | [sab_65](https://harnessreport.com/tasks/scienceagentbench/sab_65.md) | medium | | | 0 | | [sab_66](https://harnessreport.com/tasks/scienceagentbench/sab_66.md) | medium | | | 0 | | [sab_67](https://harnessreport.com/tasks/scienceagentbench/sab_67.md) | medium | | | 0 | | [sab_68](https://harnessreport.com/tasks/scienceagentbench/sab_68.md) | medium | | | 0 | | [sab_69](https://harnessreport.com/tasks/scienceagentbench/sab_69.md) | medium | | | 0 | | [sab_7](https://harnessreport.com/tasks/scienceagentbench/sab_7.md) | medium | | | 0 | | [sab_70](https://harnessreport.com/tasks/scienceagentbench/sab_70.md) | hard | | | 0 | | [sab_71](https://harnessreport.com/tasks/scienceagentbench/sab_71.md) | hard | | | 0 | | [sab_72](https://harnessreport.com/tasks/scienceagentbench/sab_72.md) | hard | | | 0 | | [sab_73](https://harnessreport.com/tasks/scienceagentbench/sab_73.md) | medium | | | 0 | | [sab_74](https://harnessreport.com/tasks/scienceagentbench/sab_74.md) | medium | | | 0 | | [sab_75](https://harnessreport.com/tasks/scienceagentbench/sab_75.md) | hard | | | 0 | | [sab_76](https://harnessreport.com/tasks/scienceagentbench/sab_76.md) | hard | | | 0 | | [sab_77](https://harnessreport.com/tasks/scienceagentbench/sab_77.md) | medium | | | 0 | | [sab_78](https://harnessreport.com/tasks/scienceagentbench/sab_78.md) | hard | | | 0 | | [sab_79](https://harnessreport.com/tasks/scienceagentbench/sab_79.md) | medium | | | 0 | | [sab_8](https://harnessreport.com/tasks/scienceagentbench/sab_8.md) | medium | | | 0 | | [sab_80](https://harnessreport.com/tasks/scienceagentbench/sab_80.md) | medium | | | 0 | | [sab_81](https://harnessreport.com/tasks/scienceagentbench/sab_81.md) | medium | | | 0 | | [sab_82](https://harnessreport.com/tasks/scienceagentbench/sab_82.md) | medium | | | 0 | | [sab_83](https://harnessreport.com/tasks/scienceagentbench/sab_83.md) | medium | | | 0 | | [sab_84](https://harnessreport.com/tasks/scienceagentbench/sab_84.md) | medium | | | 0 | | [sab_85](https://harnessreport.com/tasks/scienceagentbench/sab_85.md) | medium | | | 0 | | [sab_86](https://harnessreport.com/tasks/scienceagentbench/sab_86.md) | medium | | | 0 | | [sab_87](https://harnessreport.com/tasks/scienceagentbench/sab_87.md) | medium | | | 0 | | [sab_88](https://harnessreport.com/tasks/scienceagentbench/sab_88.md) | medium | | | 0 | | [sab_89](https://harnessreport.com/tasks/scienceagentbench/sab_89.md) | medium | | | 0 | | [sab_9](https://harnessreport.com/tasks/scienceagentbench/sab_9.md) | medium | | | 0 | | [sab_90](https://harnessreport.com/tasks/scienceagentbench/sab_90.md) | medium | | | 0 | | [sab_91](https://harnessreport.com/tasks/scienceagentbench/sab_91.md) | medium | | | 0 | | [sab_92](https://harnessreport.com/tasks/scienceagentbench/sab_92.md) | medium | | | 0 | | [sab_93](https://harnessreport.com/tasks/scienceagentbench/sab_93.md) | medium | | | 0 | | [sab_94](https://harnessreport.com/tasks/scienceagentbench/sab_94.md) | medium | | | 0 | | [sab_95](https://harnessreport.com/tasks/scienceagentbench/sab_95.md) | hard | | | 0 | | [sab_96](https://harnessreport.com/tasks/scienceagentbench/sab_96.md) | medium | | | 0 | | [sab_97](https://harnessreport.com/tasks/scienceagentbench/sab_97.md) | hard | | | 0 | | [sab_98](https://harnessreport.com/tasks/scienceagentbench/sab_98.md) | medium | | | 0 | | [sab_99](https://harnessreport.com/tasks/scienceagentbench/sab_99.md) | medium | | | 0 | --- Harness Report runs agent harnesses from their GitHub repos on Harbor tasks and records every model call. Every page is also `.md` and `.json`; index: https://harnessreport.com/llms.txt · MCP: https://harnessreport.com/mcp