# bixbench - domain: life-sciences - n_tasks: 205 - n_runnable: 0 - owner_org: FutureHouse - grading: mixed - task_kind: computational biology analysis capsules in notebooks - url_repo: https://github.com/Future-House/BixBench - url_paper: https://arxiv.org/abs/2503.00096 ## Tasks | task | difficulty | language | runnable | harnesses tried | |---|---|---|---|---| | [bix-1-q1](https://harnessreport.com/tasks/bixbench/bix-1-q1.md) | hard | | | 0 | | [bix-1-q2](https://harnessreport.com/tasks/bixbench/bix-1-q2.md) | hard | | | 0 | | [bix-10-q1](https://harnessreport.com/tasks/bixbench/bix-10-q1.md) | hard | | | 0 | | [bix-10-q2](https://harnessreport.com/tasks/bixbench/bix-10-q2.md) | hard | | | 0 | | [bix-10-q3](https://harnessreport.com/tasks/bixbench/bix-10-q3.md) | hard | | | 0 | | [bix-10-q4](https://harnessreport.com/tasks/bixbench/bix-10-q4.md) | hard | | | 0 | | [bix-10-q5](https://harnessreport.com/tasks/bixbench/bix-10-q5.md) | hard | | | 0 | | [bix-10-q6](https://harnessreport.com/tasks/bixbench/bix-10-q6.md) | hard | | | 0 | | [bix-10-q7](https://harnessreport.com/tasks/bixbench/bix-10-q7.md) | hard | | | 0 | | [bix-11-q1](https://harnessreport.com/tasks/bixbench/bix-11-q1.md) | hard | | | 0 | | [bix-11-q2](https://harnessreport.com/tasks/bixbench/bix-11-q2.md) | hard | | | 0 | | [bix-11-q3](https://harnessreport.com/tasks/bixbench/bix-11-q3.md) | hard | | | 0 | | [bix-11-q4](https://harnessreport.com/tasks/bixbench/bix-11-q4.md) | hard | | | 0 | | [bix-11-q5](https://harnessreport.com/tasks/bixbench/bix-11-q5.md) | hard | | | 0 | | [bix-11-q6](https://harnessreport.com/tasks/bixbench/bix-11-q6.md) | hard | | | 0 | | [bix-12-q2](https://harnessreport.com/tasks/bixbench/bix-12-q2.md) | hard | | | 0 | | [bix-12-q3](https://harnessreport.com/tasks/bixbench/bix-12-q3.md) | hard | | | 0 | | [bix-12-q4](https://harnessreport.com/tasks/bixbench/bix-12-q4.md) | hard | | | 0 | | [bix-12-q5](https://harnessreport.com/tasks/bixbench/bix-12-q5.md) | hard | | | 0 | | [bix-12-q6](https://harnessreport.com/tasks/bixbench/bix-12-q6.md) | hard | | | 0 | | [bix-13-q1](https://harnessreport.com/tasks/bixbench/bix-13-q1.md) | hard | | | 0 | | [bix-13-q2](https://harnessreport.com/tasks/bixbench/bix-13-q2.md) | hard | | | 0 | | [bix-13-q3](https://harnessreport.com/tasks/bixbench/bix-13-q3.md) | hard | | | 0 | | [bix-13-q4](https://harnessreport.com/tasks/bixbench/bix-13-q4.md) | hard | | | 0 | | [bix-13-q5](https://harnessreport.com/tasks/bixbench/bix-13-q5.md) | hard | | | 0 | | [bix-14-q1](https://harnessreport.com/tasks/bixbench/bix-14-q1.md) | hard | | | 0 | | [bix-14-q2](https://harnessreport.com/tasks/bixbench/bix-14-q2.md) | hard | | | 0 | | [bix-14-q3](https://harnessreport.com/tasks/bixbench/bix-14-q3.md) | hard | | | 0 | | [bix-16-q1](https://harnessreport.com/tasks/bixbench/bix-16-q1.md) | hard | | | 0 | | [bix-16-q2](https://harnessreport.com/tasks/bixbench/bix-16-q2.md) | hard | | | 0 | | [bix-16-q3](https://harnessreport.com/tasks/bixbench/bix-16-q3.md) | hard | | | 0 | | [bix-16-q4](https://harnessreport.com/tasks/bixbench/bix-16-q4.md) | hard | | | 0 | | [bix-17-q2](https://harnessreport.com/tasks/bixbench/bix-17-q2.md) | hard | | | 0 | | [bix-18-q1](https://harnessreport.com/tasks/bixbench/bix-18-q1.md) | hard | | | 0 | | [bix-18-q2](https://harnessreport.com/tasks/bixbench/bix-18-q2.md) | hard | | | 0 | | [bix-18-q3](https://harnessreport.com/tasks/bixbench/bix-18-q3.md) | hard | | | 0 | | [bix-18-q4](https://harnessreport.com/tasks/bixbench/bix-18-q4.md) | hard | | | 0 | | [bix-18-q5](https://harnessreport.com/tasks/bixbench/bix-18-q5.md) | hard | | | 0 | | [bix-19-q1](https://harnessreport.com/tasks/bixbench/bix-19-q1.md) | hard | | | 0 | | [bix-19-q2](https://harnessreport.com/tasks/bixbench/bix-19-q2.md) | hard | | | 0 | | [bix-19-q3](https://harnessreport.com/tasks/bixbench/bix-19-q3.md) | hard | | | 0 | | [bix-19-q4](https://harnessreport.com/tasks/bixbench/bix-19-q4.md) | hard | | | 0 | | [bix-19-q5](https://harnessreport.com/tasks/bixbench/bix-19-q5.md) | hard | | | 0 | | [bix-2-q1](https://harnessreport.com/tasks/bixbench/bix-2-q1.md) | hard | | | 0 | | [bix-2-q2](https://harnessreport.com/tasks/bixbench/bix-2-q2.md) | hard | | | 0 | | [bix-20-q1](https://harnessreport.com/tasks/bixbench/bix-20-q1.md) | hard | | | 0 | | [bix-20-q2](https://harnessreport.com/tasks/bixbench/bix-20-q2.md) | hard | | | 0 | | [bix-20-q3](https://harnessreport.com/tasks/bixbench/bix-20-q3.md) | hard | | | 0 | | [bix-20-q4](https://harnessreport.com/tasks/bixbench/bix-20-q4.md) | hard | | | 0 | | [bix-21-q2](https://harnessreport.com/tasks/bixbench/bix-21-q2.md) | hard | | | 0 | | [bix-22-q1](https://harnessreport.com/tasks/bixbench/bix-22-q1.md) | hard | | | 0 | | [bix-22-q2](https://harnessreport.com/tasks/bixbench/bix-22-q2.md) | hard | | | 0 | | [bix-22-q3](https://harnessreport.com/tasks/bixbench/bix-22-q3.md) | hard | | | 0 | | [bix-22-q4](https://harnessreport.com/tasks/bixbench/bix-22-q4.md) | hard | | | 0 | | [bix-22-q6](https://harnessreport.com/tasks/bixbench/bix-22-q6.md) | hard | | | 0 | | [bix-24-q1](https://harnessreport.com/tasks/bixbench/bix-24-q1.md) | hard | | | 0 | | [bix-24-q2](https://harnessreport.com/tasks/bixbench/bix-24-q2.md) | hard | | | 0 | | [bix-24-q6](https://harnessreport.com/tasks/bixbench/bix-24-q6.md) | hard | | | 0 | | [bix-25-q1](https://harnessreport.com/tasks/bixbench/bix-25-q1.md) | hard | | | 0 | | [bix-25-q4](https://harnessreport.com/tasks/bixbench/bix-25-q4.md) | hard | | | 0 | | [bix-26-q3](https://harnessreport.com/tasks/bixbench/bix-26-q3.md) | hard | | | 0 | | [bix-26-q4](https://harnessreport.com/tasks/bixbench/bix-26-q4.md) | hard | | | 0 | | [bix-26-q5](https://harnessreport.com/tasks/bixbench/bix-26-q5.md) | hard | | | 0 | | [bix-27-q2](https://harnessreport.com/tasks/bixbench/bix-27-q2.md) | hard | | | 0 | | [bix-27-q4](https://harnessreport.com/tasks/bixbench/bix-27-q4.md) | hard | | | 0 | | [bix-27-q5](https://harnessreport.com/tasks/bixbench/bix-27-q5.md) | hard | | | 0 | | [bix-28-q1](https://harnessreport.com/tasks/bixbench/bix-28-q1.md) | hard | | | 0 | | [bix-28-q2](https://harnessreport.com/tasks/bixbench/bix-28-q2.md) | hard | | | 0 | | [bix-28-q3](https://harnessreport.com/tasks/bixbench/bix-28-q3.md) | hard | | | 0 | | [bix-28-q4](https://harnessreport.com/tasks/bixbench/bix-28-q4.md) | hard | | | 0 | | [bix-28-q5](https://harnessreport.com/tasks/bixbench/bix-28-q5.md) | hard | | | 0 | | [bix-28-q6](https://harnessreport.com/tasks/bixbench/bix-28-q6.md) | hard | | | 0 | | [bix-29-q1](https://harnessreport.com/tasks/bixbench/bix-29-q1.md) | hard | | | 0 | | [bix-29-q2](https://harnessreport.com/tasks/bixbench/bix-29-q2.md) | hard | | | 0 | | [bix-29-q3](https://harnessreport.com/tasks/bixbench/bix-29-q3.md) | hard | | | 0 | | [bix-29-q4](https://harnessreport.com/tasks/bixbench/bix-29-q4.md) | hard | | | 0 | | [bix-3-q1](https://harnessreport.com/tasks/bixbench/bix-3-q1.md) | hard | | | 0 | | [bix-3-q2](https://harnessreport.com/tasks/bixbench/bix-3-q2.md) | hard | | | 0 | | [bix-3-q3](https://harnessreport.com/tasks/bixbench/bix-3-q3.md) | hard | | | 0 | | [bix-3-q4](https://harnessreport.com/tasks/bixbench/bix-3-q4.md) | hard | | | 0 | | [bix-3-q5](https://harnessreport.com/tasks/bixbench/bix-3-q5.md) | hard | | | 0 | | [bix-30-q1](https://harnessreport.com/tasks/bixbench/bix-30-q1.md) | hard | | | 0 | | [bix-30-q3](https://harnessreport.com/tasks/bixbench/bix-30-q3.md) | hard | | | 0 | | [bix-30-q5](https://harnessreport.com/tasks/bixbench/bix-30-q5.md) | hard | | | 0 | | [bix-30-q6](https://harnessreport.com/tasks/bixbench/bix-30-q6.md) | hard | | | 0 | | [bix-31-q1](https://harnessreport.com/tasks/bixbench/bix-31-q1.md) | hard | | | 0 | | [bix-31-q2](https://harnessreport.com/tasks/bixbench/bix-31-q2.md) | hard | | | 0 | | [bix-31-q3](https://harnessreport.com/tasks/bixbench/bix-31-q3.md) | hard | | | 0 | | [bix-31-q4](https://harnessreport.com/tasks/bixbench/bix-31-q4.md) | hard | | | 0 | | [bix-32-q2](https://harnessreport.com/tasks/bixbench/bix-32-q2.md) | hard | | | 0 | | [bix-32-q3](https://harnessreport.com/tasks/bixbench/bix-32-q3.md) | hard | | | 0 | | [bix-32-q4](https://harnessreport.com/tasks/bixbench/bix-32-q4.md) | hard | | | 0 | | [bix-33-q1](https://harnessreport.com/tasks/bixbench/bix-33-q1.md) | hard | | | 0 | | [bix-33-q6](https://harnessreport.com/tasks/bixbench/bix-33-q6.md) | hard | | | 0 | | [bix-34-q1](https://harnessreport.com/tasks/bixbench/bix-34-q1.md) | hard | | | 0 | | [bix-34-q2](https://harnessreport.com/tasks/bixbench/bix-34-q2.md) | hard | | | 0 | | [bix-34-q3](https://harnessreport.com/tasks/bixbench/bix-34-q3.md) | hard | | | 0 | | [bix-34-q4](https://harnessreport.com/tasks/bixbench/bix-34-q4.md) | hard | | | 0 | | [bix-34-q5](https://harnessreport.com/tasks/bixbench/bix-34-q5.md) | hard | | | 0 | | [bix-34-q6](https://harnessreport.com/tasks/bixbench/bix-34-q6.md) | hard | | | 0 | | [bix-35-q1](https://harnessreport.com/tasks/bixbench/bix-35-q1.md) | hard | | | 0 | | [bix-35-q2](https://harnessreport.com/tasks/bixbench/bix-35-q2.md) | hard | | | 0 | | [bix-35-q3](https://harnessreport.com/tasks/bixbench/bix-35-q3.md) | hard | | | 0 | | [bix-35-q4](https://harnessreport.com/tasks/bixbench/bix-35-q4.md) | hard | | | 0 | | [bix-36-q1](https://harnessreport.com/tasks/bixbench/bix-36-q1.md) | hard | | | 0 | | [bix-36-q3](https://harnessreport.com/tasks/bixbench/bix-36-q3.md) | hard | | | 0 | | [bix-36-q4](https://harnessreport.com/tasks/bixbench/bix-36-q4.md) | hard | | | 0 | | [bix-36-q5](https://harnessreport.com/tasks/bixbench/bix-36-q5.md) | hard | | | 0 | | [bix-37-q1](https://harnessreport.com/tasks/bixbench/bix-37-q1.md) | hard | | | 0 | | [bix-37-q2](https://harnessreport.com/tasks/bixbench/bix-37-q2.md) | hard | | | 0 | | [bix-37-q3](https://harnessreport.com/tasks/bixbench/bix-37-q3.md) | hard | | | 0 | | [bix-37-q4](https://harnessreport.com/tasks/bixbench/bix-37-q4.md) | hard | | | 0 | | [bix-38-q1](https://harnessreport.com/tasks/bixbench/bix-38-q1.md) | hard | | | 0 | | [bix-38-q2](https://harnessreport.com/tasks/bixbench/bix-38-q2.md) | hard | | | 0 | | [bix-38-q3](https://harnessreport.com/tasks/bixbench/bix-38-q3.md) | hard | | | 0 | | [bix-38-q5](https://harnessreport.com/tasks/bixbench/bix-38-q5.md) | hard | | | 0 | | [bix-38-q6](https://harnessreport.com/tasks/bixbench/bix-38-q6.md) | hard | | | 0 | | [bix-39-q2](https://harnessreport.com/tasks/bixbench/bix-39-q2.md) | hard | | | 0 | | [bix-4-q1](https://harnessreport.com/tasks/bixbench/bix-4-q1.md) | hard | | | 0 | | [bix-4-q2](https://harnessreport.com/tasks/bixbench/bix-4-q2.md) | hard | | | 0 | | [bix-4-q3](https://harnessreport.com/tasks/bixbench/bix-4-q3.md) | hard | | | 0 | | [bix-4-q4](https://harnessreport.com/tasks/bixbench/bix-4-q4.md) | hard | | | 0 | | [bix-4-q5](https://harnessreport.com/tasks/bixbench/bix-4-q5.md) | hard | | | 0 | | [bix-4-q6](https://harnessreport.com/tasks/bixbench/bix-4-q6.md) | hard | | | 0 | | [bix-4-q7](https://harnessreport.com/tasks/bixbench/bix-4-q7.md) | hard | | | 0 | | [bix-41-q1](https://harnessreport.com/tasks/bixbench/bix-41-q1.md) | hard | | | 0 | | [bix-41-q3](https://harnessreport.com/tasks/bixbench/bix-41-q3.md) | hard | | | 0 | | [bix-41-q4](https://harnessreport.com/tasks/bixbench/bix-41-q4.md) | hard | | | 0 | | [bix-41-q5](https://harnessreport.com/tasks/bixbench/bix-41-q5.md) | hard | | | 0 | | [bix-42-q1](https://harnessreport.com/tasks/bixbench/bix-42-q1.md) | hard | | | 0 | | [bix-42-q2](https://harnessreport.com/tasks/bixbench/bix-42-q2.md) | hard | | | 0 | | [bix-43-q1](https://harnessreport.com/tasks/bixbench/bix-43-q1.md) | hard | | | 0 | | [bix-43-q2](https://harnessreport.com/tasks/bixbench/bix-43-q2.md) | hard | | | 0 | | [bix-43-q3](https://harnessreport.com/tasks/bixbench/bix-43-q3.md) | hard | | | 0 | | [bix-43-q4](https://harnessreport.com/tasks/bixbench/bix-43-q4.md) | hard | | | 0 | | [bix-43-q5](https://harnessreport.com/tasks/bixbench/bix-43-q5.md) | hard | | | 0 | | [bix-45-q1](https://harnessreport.com/tasks/bixbench/bix-45-q1.md) | hard | | | 0 | | [bix-45-q2](https://harnessreport.com/tasks/bixbench/bix-45-q2.md) | hard | | | 0 | | [bix-45-q5](https://harnessreport.com/tasks/bixbench/bix-45-q5.md) | hard | | | 0 | | [bix-45-q6](https://harnessreport.com/tasks/bixbench/bix-45-q6.md) | hard | | | 0 | | [bix-46-q1](https://harnessreport.com/tasks/bixbench/bix-46-q1.md) | hard | | | 0 | | [bix-46-q4](https://harnessreport.com/tasks/bixbench/bix-46-q4.md) | hard | | | 0 | | [bix-47-q2](https://harnessreport.com/tasks/bixbench/bix-47-q2.md) | hard | | | 0 | | [bix-47-q3](https://harnessreport.com/tasks/bixbench/bix-47-q3.md) | hard | | | 0 | | [bix-49-q1](https://harnessreport.com/tasks/bixbench/bix-49-q1.md) | hard | | | 0 | | [bix-49-q2](https://harnessreport.com/tasks/bixbench/bix-49-q2.md) | hard | | | 0 | | [bix-49-q3](https://harnessreport.com/tasks/bixbench/bix-49-q3.md) | hard | | | 0 | | [bix-49-q4](https://harnessreport.com/tasks/bixbench/bix-49-q4.md) | hard | | | 0 | | [bix-49-q5](https://harnessreport.com/tasks/bixbench/bix-49-q5.md) | hard | | | 0 | | [bix-5-q1](https://harnessreport.com/tasks/bixbench/bix-5-q1.md) | hard | | | 0 | | [bix-5-q4](https://harnessreport.com/tasks/bixbench/bix-5-q4.md) | hard | | | 0 | | [bix-51-q1](https://harnessreport.com/tasks/bixbench/bix-51-q1.md) | hard | | | 0 | | [bix-51-q2](https://harnessreport.com/tasks/bixbench/bix-51-q2.md) | hard | | | 0 | | [bix-51-q3](https://harnessreport.com/tasks/bixbench/bix-51-q3.md) | hard | | | 0 | | [bix-51-q4](https://harnessreport.com/tasks/bixbench/bix-51-q4.md) | hard | | | 0 | | [bix-51-q5](https://harnessreport.com/tasks/bixbench/bix-51-q5.md) | hard | | | 0 | | [bix-51-q6](https://harnessreport.com/tasks/bixbench/bix-51-q6.md) | hard | | | 0 | | [bix-51-q8](https://harnessreport.com/tasks/bixbench/bix-51-q8.md) | hard | | | 0 | | [bix-52-q1](https://harnessreport.com/tasks/bixbench/bix-52-q1.md) | hard | | | 0 | | [bix-52-q2](https://harnessreport.com/tasks/bixbench/bix-52-q2.md) | hard | | | 0 | | [bix-52-q3](https://harnessreport.com/tasks/bixbench/bix-52-q3.md) | hard | | | 0 | | [bix-52-q5](https://harnessreport.com/tasks/bixbench/bix-52-q5.md) | hard | | | 0 | | [bix-52-q6](https://harnessreport.com/tasks/bixbench/bix-52-q6.md) | hard | | | 0 | | [bix-52-q7](https://harnessreport.com/tasks/bixbench/bix-52-q7.md) | hard | | | 0 | | [bix-53-q2](https://harnessreport.com/tasks/bixbench/bix-53-q2.md) | hard | | | 0 | | [bix-53-q3](https://harnessreport.com/tasks/bixbench/bix-53-q3.md) | hard | | | 0 | | [bix-53-q4](https://harnessreport.com/tasks/bixbench/bix-53-q4.md) | hard | | | 0 | | [bix-53-q5](https://harnessreport.com/tasks/bixbench/bix-53-q5.md) | hard | | | 0 | | [bix-53-q6](https://harnessreport.com/tasks/bixbench/bix-53-q6.md) | hard | | | 0 | | [bix-54-q1](https://harnessreport.com/tasks/bixbench/bix-54-q1.md) | hard | | | 0 | | [bix-54-q2](https://harnessreport.com/tasks/bixbench/bix-54-q2.md) | hard | | | 0 | | [bix-54-q3](https://harnessreport.com/tasks/bixbench/bix-54-q3.md) | hard | | | 0 | | [bix-54-q4](https://harnessreport.com/tasks/bixbench/bix-54-q4.md) | hard | | | 0 | | [bix-54-q5](https://harnessreport.com/tasks/bixbench/bix-54-q5.md) | hard | | | 0 | | [bix-54-q6](https://harnessreport.com/tasks/bixbench/bix-54-q6.md) | hard | | | 0 | | [bix-54-q7](https://harnessreport.com/tasks/bixbench/bix-54-q7.md) | hard | | | 0 | | [bix-55-q1](https://harnessreport.com/tasks/bixbench/bix-55-q1.md) | hard | | | 0 | | [bix-56-q1](https://harnessreport.com/tasks/bixbench/bix-56-q1.md) | hard | | | 0 | | [bix-57-q1](https://harnessreport.com/tasks/bixbench/bix-57-q1.md) | hard | | | 0 | | [bix-58-q1](https://harnessreport.com/tasks/bixbench/bix-58-q1.md) | hard | | | 0 | | [bix-6-q1](https://harnessreport.com/tasks/bixbench/bix-6-q1.md) | hard | | | 0 | | [bix-6-q3](https://harnessreport.com/tasks/bixbench/bix-6-q3.md) | hard | | | 0 | | [bix-6-q4](https://harnessreport.com/tasks/bixbench/bix-6-q4.md) | hard | | | 0 | | [bix-6-q5](https://harnessreport.com/tasks/bixbench/bix-6-q5.md) | hard | | | 0 | | [bix-6-q6](https://harnessreport.com/tasks/bixbench/bix-6-q6.md) | hard | | | 0 | | [bix-6-q7](https://harnessreport.com/tasks/bixbench/bix-6-q7.md) | hard | | | 0 | | [bix-60-q1](https://harnessreport.com/tasks/bixbench/bix-60-q1.md) | hard | | | 0 | | [bix-61-q1](https://harnessreport.com/tasks/bixbench/bix-61-q1.md) | hard | | | 0 | | [bix-61-q2](https://harnessreport.com/tasks/bixbench/bix-61-q2.md) | hard | | | 0 | | [bix-61-q3](https://harnessreport.com/tasks/bixbench/bix-61-q3.md) | hard | | | 0 | | [bix-61-q4](https://harnessreport.com/tasks/bixbench/bix-61-q4.md) | hard | | | 0 | | [bix-61-q5](https://harnessreport.com/tasks/bixbench/bix-61-q5.md) | hard | | | 0 | | [bix-61-q6](https://harnessreport.com/tasks/bixbench/bix-61-q6.md) | hard | | | 0 | | [bix-7-q1](https://harnessreport.com/tasks/bixbench/bix-7-q1.md) | hard | | | 0 | | [bix-7-q2](https://harnessreport.com/tasks/bixbench/bix-7-q2.md) | hard | | | 0 | | [bix-7-q3](https://harnessreport.com/tasks/bixbench/bix-7-q3.md) | hard | | | 0 | | [bix-8-q1](https://harnessreport.com/tasks/bixbench/bix-8-q1.md) | hard | | | 0 | | [bix-8-q2](https://harnessreport.com/tasks/bixbench/bix-8-q2.md) | hard | | | 0 | | [bix-8-q3](https://harnessreport.com/tasks/bixbench/bix-8-q3.md) | hard | | | 0 | | [bix-8-q5](https://harnessreport.com/tasks/bixbench/bix-8-q5.md) | hard | | | 0 | More: https://harnessreport.com/tasks/bixbench.md?after=bix-8-q5 --- Harness Report runs agent harnesses from their GitHub repos on Harbor tasks and records every model call. Every page is also `.md` and `.json`; index: https://harnessreport.com/llms.txt · MCP: https://harnessreport.com/mcp