# bird-bench - domain: data-sql - n_tasks: 1534 - n_runnable: 3 ## Tasks | task | difficulty | language | runnable | harnesses tried | |---|---|---|---|---| | [california_schools__0](https://harnessreport.com/tasks/bird-bench/california_schools__0.md) | hard | | | 0 | | [california_schools__1](https://harnessreport.com/tasks/bird-bench/california_schools__1.md) | medium | | | 0 | | [california_schools__10](https://harnessreport.com/tasks/bird-bench/california_schools__10.md) | hard | | | 0 | | [california_schools__11](https://harnessreport.com/tasks/bird-bench/california_schools__11.md) | hard | | | 0 | | [california_schools__12](https://harnessreport.com/tasks/bird-bench/california_schools__12.md) | hard | | | 0 | | [california_schools__13](https://harnessreport.com/tasks/bird-bench/california_schools__13.md) | hard | | | 0 | | [california_schools__14](https://harnessreport.com/tasks/bird-bench/california_schools__14.md) | easy | | | 0 | | [california_schools__15](https://harnessreport.com/tasks/bird-bench/california_schools__15.md) | easy | | | 0 | | [california_schools__16](https://harnessreport.com/tasks/bird-bench/california_schools__16.md) | easy | | | 0 | | [california_schools__17](https://harnessreport.com/tasks/bird-bench/california_schools__17.md) | easy | | | 0 | | [california_schools__18](https://harnessreport.com/tasks/bird-bench/california_schools__18.md) | hard | | | 0 | | [california_schools__19](https://harnessreport.com/tasks/bird-bench/california_schools__19.md) | hard | | | 0 | | [california_schools__2](https://harnessreport.com/tasks/bird-bench/california_schools__2.md) | hard | | | 0 | | [california_schools__20](https://harnessreport.com/tasks/bird-bench/california_schools__20.md) | hard | | | 0 | | [california_schools__21](https://harnessreport.com/tasks/bird-bench/california_schools__21.md) | hard | | | 0 | | [california_schools__22](https://harnessreport.com/tasks/bird-bench/california_schools__22.md) | easy | | | 0 | | [california_schools__23](https://harnessreport.com/tasks/bird-bench/california_schools__23.md) | medium | | | 0 | | [california_schools__24](https://harnessreport.com/tasks/bird-bench/california_schools__24.md) | medium | | | 0 | | [california_schools__25](https://harnessreport.com/tasks/bird-bench/california_schools__25.md) | medium | | | 0 | | [california_schools__26](https://harnessreport.com/tasks/bird-bench/california_schools__26.md) | medium | | | 0 | | [california_schools__27](https://harnessreport.com/tasks/bird-bench/california_schools__27.md) | medium | | | 0 | | [california_schools__28](https://harnessreport.com/tasks/bird-bench/california_schools__28.md) | hard | | | 0 | | [california_schools__29](https://harnessreport.com/tasks/bird-bench/california_schools__29.md) | easy | | | 0 | | [california_schools__3](https://harnessreport.com/tasks/bird-bench/california_schools__3.md) | hard | | | 0 | | [california_schools__30](https://harnessreport.com/tasks/bird-bench/california_schools__30.md) | easy | | | 0 | | [california_schools__31](https://harnessreport.com/tasks/bird-bench/california_schools__31.md) | hard | | | 0 | | [california_schools__32](https://harnessreport.com/tasks/bird-bench/california_schools__32.md) | hard | | | 0 | | [california_schools__33](https://harnessreport.com/tasks/bird-bench/california_schools__33.md) | medium | | | 0 | | [california_schools__34](https://harnessreport.com/tasks/bird-bench/california_schools__34.md) | medium | | | 0 | | [california_schools__35](https://harnessreport.com/tasks/bird-bench/california_schools__35.md) | medium | | | 0 | | [california_schools__36](https://harnessreport.com/tasks/bird-bench/california_schools__36.md) | hard | | | 0 | | [california_schools__37](https://harnessreport.com/tasks/bird-bench/california_schools__37.md) | medium | | | 0 | | [california_schools__38](https://harnessreport.com/tasks/bird-bench/california_schools__38.md) | easy | | | 0 | | [california_schools__39](https://harnessreport.com/tasks/bird-bench/california_schools__39.md) | easy | | | 0 | | [california_schools__4](https://harnessreport.com/tasks/bird-bench/california_schools__4.md) | medium | | | 0 | | [california_schools__40](https://harnessreport.com/tasks/bird-bench/california_schools__40.md) | medium | | | 0 | | [california_schools__41](https://harnessreport.com/tasks/bird-bench/california_schools__41.md) | easy | | | 0 | | [california_schools__42](https://harnessreport.com/tasks/bird-bench/california_schools__42.md) | easy | | | 0 | | [california_schools__43](https://harnessreport.com/tasks/bird-bench/california_schools__43.md) | medium | | | 0 | | [california_schools__44](https://harnessreport.com/tasks/bird-bench/california_schools__44.md) | easy | | | 0 | | [california_schools__45](https://harnessreport.com/tasks/bird-bench/california_schools__45.md) | hard | | | 0 | | [california_schools__46](https://harnessreport.com/tasks/bird-bench/california_schools__46.md) | easy | | | 0 | | [california_schools__47](https://harnessreport.com/tasks/bird-bench/california_schools__47.md) | medium | | | 0 | | [california_schools__48](https://harnessreport.com/tasks/bird-bench/california_schools__48.md) | medium | | | 0 | | [california_schools__49](https://harnessreport.com/tasks/bird-bench/california_schools__49.md) | medium | | | 0 | | [california_schools__5](https://harnessreport.com/tasks/bird-bench/california_schools__5.md) | hard | | | 0 | | [california_schools__50](https://harnessreport.com/tasks/bird-bench/california_schools__50.md) | easy | | | 0 | | [california_schools__51](https://harnessreport.com/tasks/bird-bench/california_schools__51.md) | easy | | | 0 | | [california_schools__52](https://harnessreport.com/tasks/bird-bench/california_schools__52.md) | easy | | | 0 | | [california_schools__53](https://harnessreport.com/tasks/bird-bench/california_schools__53.md) | easy | | | 0 | | [california_schools__54](https://harnessreport.com/tasks/bird-bench/california_schools__54.md) | easy | | | 0 | | [california_schools__55](https://harnessreport.com/tasks/bird-bench/california_schools__55.md) | hard | | | 0 | | [california_schools__56](https://harnessreport.com/tasks/bird-bench/california_schools__56.md) | easy | | | 0 | | [california_schools__57](https://harnessreport.com/tasks/bird-bench/california_schools__57.md) | easy | | | 0 | | [california_schools__58](https://harnessreport.com/tasks/bird-bench/california_schools__58.md) | easy | | | 0 | | [california_schools__59](https://harnessreport.com/tasks/bird-bench/california_schools__59.md) | easy | | | 0 | | [california_schools__6](https://harnessreport.com/tasks/bird-bench/california_schools__6.md) | hard | | | 0 | | [california_schools__60](https://harnessreport.com/tasks/bird-bench/california_schools__60.md) | hard | | | 0 | | [california_schools__61](https://harnessreport.com/tasks/bird-bench/california_schools__61.md) | hard | | | 0 | | [california_schools__62](https://harnessreport.com/tasks/bird-bench/california_schools__62.md) | hard | | | 0 | | [california_schools__63](https://harnessreport.com/tasks/bird-bench/california_schools__63.md) | easy | | | 0 | | [california_schools__64](https://harnessreport.com/tasks/bird-bench/california_schools__64.md) | easy | | | 0 | | [california_schools__65](https://harnessreport.com/tasks/bird-bench/california_schools__65.md) | medium | | | 0 | | [california_schools__66](https://harnessreport.com/tasks/bird-bench/california_schools__66.md) | hard | | | 0 | | [california_schools__67](https://harnessreport.com/tasks/bird-bench/california_schools__67.md) | easy | | | 0 | | [california_schools__68](https://harnessreport.com/tasks/bird-bench/california_schools__68.md) | medium | | | 0 | | [california_schools__69](https://harnessreport.com/tasks/bird-bench/california_schools__69.md) | hard | | | 0 | | [california_schools__7](https://harnessreport.com/tasks/bird-bench/california_schools__7.md) | easy | | | 0 | | [california_schools__70](https://harnessreport.com/tasks/bird-bench/california_schools__70.md) | easy | | | 0 | | [california_schools__71](https://harnessreport.com/tasks/bird-bench/california_schools__71.md) | easy | | | 0 | | [california_schools__72](https://harnessreport.com/tasks/bird-bench/california_schools__72.md) | medium | | | 0 | | [california_schools__73](https://harnessreport.com/tasks/bird-bench/california_schools__73.md) | easy | | | 0 | | [california_schools__74](https://harnessreport.com/tasks/bird-bench/california_schools__74.md) | medium | | | 0 | | [california_schools__75](https://harnessreport.com/tasks/bird-bench/california_schools__75.md) | easy | | | 0 | | [california_schools__76](https://harnessreport.com/tasks/bird-bench/california_schools__76.md) | medium | | | 0 | | [california_schools__77](https://harnessreport.com/tasks/bird-bench/california_schools__77.md) | hard | | | 0 | | [california_schools__78](https://harnessreport.com/tasks/bird-bench/california_schools__78.md) | hard | | | 0 | | [california_schools__79](https://harnessreport.com/tasks/bird-bench/california_schools__79.md) | hard | | | 0 | | [california_schools__8](https://harnessreport.com/tasks/bird-bench/california_schools__8.md) | hard | | | 0 | | [california_schools__80](https://harnessreport.com/tasks/bird-bench/california_schools__80.md) | easy | | | 0 | | [california_schools__81](https://harnessreport.com/tasks/bird-bench/california_schools__81.md) | medium | | | 0 | | [california_schools__82](https://harnessreport.com/tasks/bird-bench/california_schools__82.md) | easy | | | 0 | | [california_schools__83](https://harnessreport.com/tasks/bird-bench/california_schools__83.md) | hard | | | 0 | | [california_schools__84](https://harnessreport.com/tasks/bird-bench/california_schools__84.md) | easy | | | 0 | | [california_schools__85](https://harnessreport.com/tasks/bird-bench/california_schools__85.md) | medium | | | 0 | | [california_schools__86](https://harnessreport.com/tasks/bird-bench/california_schools__86.md) | easy | | | 0 | | [california_schools__87](https://harnessreport.com/tasks/bird-bench/california_schools__87.md) | hard | | | 0 | | [california_schools__88](https://harnessreport.com/tasks/bird-bench/california_schools__88.md) | easy | | | 0 | | [california_schools__9](https://harnessreport.com/tasks/bird-bench/california_schools__9.md) | easy | | | 0 | | [card_games__340](https://harnessreport.com/tasks/bird-bench/card_games__340.md) | easy | | | 0 | | [card_games__341](https://harnessreport.com/tasks/bird-bench/card_games__341.md) | easy | | | 0 | | [card_games__342](https://harnessreport.com/tasks/bird-bench/card_games__342.md) | easy | | | 0 | | [card_games__343](https://harnessreport.com/tasks/bird-bench/card_games__343.md) | easy | | | 0 | | [card_games__344](https://harnessreport.com/tasks/bird-bench/card_games__344.md) | medium | | | 0 | | [card_games__345](https://harnessreport.com/tasks/bird-bench/card_games__345.md) | medium | | | 0 | | [card_games__346](https://harnessreport.com/tasks/bird-bench/card_games__346.md) | medium | | | 0 | | [card_games__347](https://harnessreport.com/tasks/bird-bench/card_games__347.md) | medium | | | 0 | | [card_games__348](https://harnessreport.com/tasks/bird-bench/card_games__348.md) | easy | | | 0 | | [card_games__349](https://harnessreport.com/tasks/bird-bench/card_games__349.md) | medium | | | 0 | | [card_games__350](https://harnessreport.com/tasks/bird-bench/card_games__350.md) | easy | | | 0 | | [card_games__351](https://harnessreport.com/tasks/bird-bench/card_games__351.md) | easy | | | 0 | | [card_games__352](https://harnessreport.com/tasks/bird-bench/card_games__352.md) | medium | | | 0 | | [card_games__353](https://harnessreport.com/tasks/bird-bench/card_games__353.md) | easy | | | 0 | | [card_games__354](https://harnessreport.com/tasks/bird-bench/card_games__354.md) | easy | | | 0 | | [card_games__355](https://harnessreport.com/tasks/bird-bench/card_games__355.md) | easy | | | 0 | | [card_games__356](https://harnessreport.com/tasks/bird-bench/card_games__356.md) | easy | | | 0 | | [card_games__357](https://harnessreport.com/tasks/bird-bench/card_games__357.md) | easy | | | 0 | | [card_games__358](https://harnessreport.com/tasks/bird-bench/card_games__358.md) | easy | | | 0 | | [card_games__359](https://harnessreport.com/tasks/bird-bench/card_games__359.md) | easy | | | 0 | | [card_games__360](https://harnessreport.com/tasks/bird-bench/card_games__360.md) | medium | | | 0 | | [card_games__361](https://harnessreport.com/tasks/bird-bench/card_games__361.md) | easy | | | 0 | | [card_games__362](https://harnessreport.com/tasks/bird-bench/card_games__362.md) | easy | | | 0 | | [card_games__363](https://harnessreport.com/tasks/bird-bench/card_games__363.md) | easy | | | 0 | | [card_games__364](https://harnessreport.com/tasks/bird-bench/card_games__364.md) | easy | | | 0 | | [card_games__365](https://harnessreport.com/tasks/bird-bench/card_games__365.md) | easy | | | 0 | | [card_games__366](https://harnessreport.com/tasks/bird-bench/card_games__366.md) | easy | | | 0 | | [card_games__367](https://harnessreport.com/tasks/bird-bench/card_games__367.md) | easy | | | 0 | | [card_games__368](https://harnessreport.com/tasks/bird-bench/card_games__368.md) | easy | | | 0 | | [card_games__369](https://harnessreport.com/tasks/bird-bench/card_games__369.md) | easy | | | 0 | | [card_games__370](https://harnessreport.com/tasks/bird-bench/card_games__370.md) | easy | | | 0 | | [card_games__371](https://harnessreport.com/tasks/bird-bench/card_games__371.md) | hard | | | 0 | | [card_games__372](https://harnessreport.com/tasks/bird-bench/card_games__372.md) | easy | | yes | 0 | | [card_games__373](https://harnessreport.com/tasks/bird-bench/card_games__373.md) | easy | | | 0 | | [card_games__374](https://harnessreport.com/tasks/bird-bench/card_games__374.md) | easy | | | 0 | | [card_games__375](https://harnessreport.com/tasks/bird-bench/card_games__375.md) | easy | | | 0 | | [card_games__376](https://harnessreport.com/tasks/bird-bench/card_games__376.md) | easy | | | 0 | | [card_games__377](https://harnessreport.com/tasks/bird-bench/card_games__377.md) | easy | | | 0 | | [card_games__378](https://harnessreport.com/tasks/bird-bench/card_games__378.md) | easy | | | 0 | | [card_games__379](https://harnessreport.com/tasks/bird-bench/card_games__379.md) | easy | | | 0 | | [card_games__380](https://harnessreport.com/tasks/bird-bench/card_games__380.md) | easy | | | 0 | | [card_games__381](https://harnessreport.com/tasks/bird-bench/card_games__381.md) | easy | | | 0 | | [card_games__382](https://harnessreport.com/tasks/bird-bench/card_games__382.md) | easy | | | 0 | | [card_games__383](https://harnessreport.com/tasks/bird-bench/card_games__383.md) | easy | | | 0 | | [card_games__384](https://harnessreport.com/tasks/bird-bench/card_games__384.md) | easy | | | 0 | | [card_games__385](https://harnessreport.com/tasks/bird-bench/card_games__385.md) | easy | | | 0 | | [card_games__386](https://harnessreport.com/tasks/bird-bench/card_games__386.md) | easy | | | 0 | | [card_games__387](https://harnessreport.com/tasks/bird-bench/card_games__387.md) | easy | | | 0 | | [card_games__388](https://harnessreport.com/tasks/bird-bench/card_games__388.md) | easy | | | 0 | | [card_games__389](https://harnessreport.com/tasks/bird-bench/card_games__389.md) | easy | | | 0 | | [card_games__390](https://harnessreport.com/tasks/bird-bench/card_games__390.md) | easy | | | 0 | | [card_games__391](https://harnessreport.com/tasks/bird-bench/card_games__391.md) | medium | | | 0 | | [card_games__392](https://harnessreport.com/tasks/bird-bench/card_games__392.md) | easy | | | 0 | | [card_games__393](https://harnessreport.com/tasks/bird-bench/card_games__393.md) | easy | | | 0 | | [card_games__394](https://harnessreport.com/tasks/bird-bench/card_games__394.md) | easy | | | 0 | | [card_games__395](https://harnessreport.com/tasks/bird-bench/card_games__395.md) | easy | | | 0 | | [card_games__396](https://harnessreport.com/tasks/bird-bench/card_games__396.md) | easy | | | 0 | | [card_games__397](https://harnessreport.com/tasks/bird-bench/card_games__397.md) | medium | | | 0 | | [card_games__398](https://harnessreport.com/tasks/bird-bench/card_games__398.md) | easy | | | 0 | | [card_games__399](https://harnessreport.com/tasks/bird-bench/card_games__399.md) | easy | | | 0 | | [card_games__400](https://harnessreport.com/tasks/bird-bench/card_games__400.md) | easy | | | 0 | | [card_games__401](https://harnessreport.com/tasks/bird-bench/card_games__401.md) | medium | | | 0 | | [card_games__402](https://harnessreport.com/tasks/bird-bench/card_games__402.md) | medium | | | 0 | | [card_games__403](https://harnessreport.com/tasks/bird-bench/card_games__403.md) | easy | | | 0 | | [card_games__404](https://harnessreport.com/tasks/bird-bench/card_games__404.md) | easy | | | 0 | | [card_games__405](https://harnessreport.com/tasks/bird-bench/card_games__405.md) | medium | | | 0 | | [card_games__406](https://harnessreport.com/tasks/bird-bench/card_games__406.md) | easy | | | 0 | | [card_games__407](https://harnessreport.com/tasks/bird-bench/card_games__407.md) | medium | | | 0 | | [card_games__408](https://harnessreport.com/tasks/bird-bench/card_games__408.md) | medium | | | 0 | | [card_games__409](https://harnessreport.com/tasks/bird-bench/card_games__409.md) | medium | | | 0 | | [card_games__410](https://harnessreport.com/tasks/bird-bench/card_games__410.md) | easy | | | 0 | | [card_games__411](https://harnessreport.com/tasks/bird-bench/card_games__411.md) | easy | | | 0 | | [card_games__412](https://harnessreport.com/tasks/bird-bench/card_games__412.md) | medium | | | 0 | | [card_games__413](https://harnessreport.com/tasks/bird-bench/card_games__413.md) | easy | | | 0 | | [card_games__414](https://harnessreport.com/tasks/bird-bench/card_games__414.md) | easy | | | 0 | | [card_games__415](https://harnessreport.com/tasks/bird-bench/card_games__415.md) | hard | | | 0 | | [card_games__416](https://harnessreport.com/tasks/bird-bench/card_games__416.md) | hard | | | 0 | | [card_games__417](https://harnessreport.com/tasks/bird-bench/card_games__417.md) | medium | | | 0 | | [card_games__418](https://harnessreport.com/tasks/bird-bench/card_games__418.md) | easy | | | 0 | | [card_games__419](https://harnessreport.com/tasks/bird-bench/card_games__419.md) | easy | | | 0 | | [card_games__420](https://harnessreport.com/tasks/bird-bench/card_games__420.md) | easy | | | 0 | | [card_games__421](https://harnessreport.com/tasks/bird-bench/card_games__421.md) | easy | | | 0 | | [card_games__422](https://harnessreport.com/tasks/bird-bench/card_games__422.md) | easy | | | 0 | | [card_games__423](https://harnessreport.com/tasks/bird-bench/card_games__423.md) | easy | | | 0 | | [card_games__424](https://harnessreport.com/tasks/bird-bench/card_games__424.md) | easy | | | 0 | | [card_games__425](https://harnessreport.com/tasks/bird-bench/card_games__425.md) | easy | | | 0 | | [card_games__426](https://harnessreport.com/tasks/bird-bench/card_games__426.md) | easy | | | 0 | | [card_games__427](https://harnessreport.com/tasks/bird-bench/card_games__427.md) | medium | | | 0 | | [card_games__428](https://harnessreport.com/tasks/bird-bench/card_games__428.md) | easy | | | 0 | | [card_games__429](https://harnessreport.com/tasks/bird-bench/card_games__429.md) | easy | | | 0 | | [card_games__430](https://harnessreport.com/tasks/bird-bench/card_games__430.md) | easy | | | 0 | | [card_games__431](https://harnessreport.com/tasks/bird-bench/card_games__431.md) | hard | | | 0 | | [card_games__432](https://harnessreport.com/tasks/bird-bench/card_games__432.md) | medium | | | 0 | | [card_games__433](https://harnessreport.com/tasks/bird-bench/card_games__433.md) | medium | | | 0 | | [card_games__434](https://harnessreport.com/tasks/bird-bench/card_games__434.md) | medium | | | 0 | | [card_games__435](https://harnessreport.com/tasks/bird-bench/card_games__435.md) | easy | | | 0 | | [card_games__436](https://harnessreport.com/tasks/bird-bench/card_games__436.md) | easy | | | 0 | | [card_games__437](https://harnessreport.com/tasks/bird-bench/card_games__437.md) | easy | | | 0 | | [card_games__438](https://harnessreport.com/tasks/bird-bench/card_games__438.md) | easy | | | 0 | | [card_games__439](https://harnessreport.com/tasks/bird-bench/card_games__439.md) | easy | | | 0 | | [card_games__440](https://harnessreport.com/tasks/bird-bench/card_games__440.md) | easy | | | 0 | | [card_games__441](https://harnessreport.com/tasks/bird-bench/card_games__441.md) | easy | | | 0 | | [card_games__442](https://harnessreport.com/tasks/bird-bench/card_games__442.md) | easy | | | 0 | | [card_games__443](https://harnessreport.com/tasks/bird-bench/card_games__443.md) | easy | | | 0 | | [card_games__444](https://harnessreport.com/tasks/bird-bench/card_games__444.md) | easy | | | 0 | | [card_games__445](https://harnessreport.com/tasks/bird-bench/card_games__445.md) | easy | | | 0 | | [card_games__446](https://harnessreport.com/tasks/bird-bench/card_games__446.md) | medium | | | 0 | | [card_games__447](https://harnessreport.com/tasks/bird-bench/card_games__447.md) | easy | | | 0 | | [card_games__448](https://harnessreport.com/tasks/bird-bench/card_games__448.md) | easy | | | 0 | | [card_games__449](https://harnessreport.com/tasks/bird-bench/card_games__449.md) | easy | | | 0 | | [card_games__450](https://harnessreport.com/tasks/bird-bench/card_games__450.md) | medium | | | 0 | More: https://harnessreport.com/tasks/bird-bench.md?after=card_games__450 --- Harness Report runs agent harnesses from their GitHub repos on Harbor tasks and records every model call. Every page is also `.md` and `.json`; index: https://harnessreport.com/llms.txt ยท MCP: https://harnessreport.com/mcp