# featbench

- domain: swe
- n_tasks: 156
- n_runnable: 0

## Tasks

| task | difficulty | language | runnable | harnesses tried |
|---|---|---|---|---|
| [FreeOpcUa__opcua-asyncio-1655](https://harnessreport.com/tasks/featbench/FreeOpcUa__opcua-asyncio-1655.md) | hard |  |  | 0 |
| [Kozea__WeasyPrint-2252](https://harnessreport.com/tasks/featbench/Kozea__WeasyPrint-2252.md) | hard |  |  | 0 |
| [ag2ai__faststream-2073](https://harnessreport.com/tasks/featbench/ag2ai__faststream-2073.md) | hard |  |  | 0 |
| [ag2ai__faststream-2170](https://harnessreport.com/tasks/featbench/ag2ai__faststream-2170.md) | hard |  |  | 0 |
| [ag2ai__faststream-2309](https://harnessreport.com/tasks/featbench/ag2ai__faststream-2309.md) | hard |  |  | 0 |
| [aiogram__aiogram-1469](https://harnessreport.com/tasks/featbench/aiogram__aiogram-1469.md) | hard |  |  | 0 |
| [aiogram__aiogram-1474](https://harnessreport.com/tasks/featbench/aiogram__aiogram-1474.md) | hard |  |  | 0 |
| [aiogram__aiogram-1594](https://harnessreport.com/tasks/featbench/aiogram__aiogram-1594.md) | hard |  |  | 0 |
| [aiogram__aiogram-1651](https://harnessreport.com/tasks/featbench/aiogram__aiogram-1651.md) | hard |  |  | 0 |
| [aiogram__aiogram-1670](https://harnessreport.com/tasks/featbench/aiogram__aiogram-1670.md) | hard |  |  | 0 |
| [aiogram__aiogram-1685](https://harnessreport.com/tasks/featbench/aiogram__aiogram-1685.md) | hard |  |  | 0 |
| [aws-cloudformation__cfn-lint-4016](https://harnessreport.com/tasks/featbench/aws-cloudformation__cfn-lint-4016.md) | hard |  |  | 0 |
| [aws-cloudformation__cfn-lint-4103](https://harnessreport.com/tasks/featbench/aws-cloudformation__cfn-lint-4103.md) | hard |  |  | 0 |
| [conan-io__conan-16317](https://harnessreport.com/tasks/featbench/conan-io__conan-16317.md) | hard |  |  | 0 |
| [conan-io__conan-16443](https://harnessreport.com/tasks/featbench/conan-io__conan-16443.md) | hard |  |  | 0 |
| [conan-io__conan-16848](https://harnessreport.com/tasks/featbench/conan-io__conan-16848.md) | hard |  |  | 0 |
| [conan-io__conan-16870](https://harnessreport.com/tasks/featbench/conan-io__conan-16870.md) | hard |  |  | 0 |
| [conan-io__conan-16876](https://harnessreport.com/tasks/featbench/conan-io__conan-16876.md) | hard |  |  | 0 |
| [conan-io__conan-16892](https://harnessreport.com/tasks/featbench/conan-io__conan-16892.md) | hard |  |  | 0 |
| [conan-io__conan-16935](https://harnessreport.com/tasks/featbench/conan-io__conan-16935.md) | hard |  |  | 0 |
| [conan-io__conan-17000](https://harnessreport.com/tasks/featbench/conan-io__conan-17000.md) | hard |  |  | 0 |
| [conan-io__conan-17076](https://harnessreport.com/tasks/featbench/conan-io__conan-17076.md) | hard |  |  | 0 |
| [conan-io__conan-17092](https://harnessreport.com/tasks/featbench/conan-io__conan-17092.md) | hard |  |  | 0 |
| [conan-io__conan-17117](https://harnessreport.com/tasks/featbench/conan-io__conan-17117.md) | hard |  |  | 0 |
| [conan-io__conan-17123](https://harnessreport.com/tasks/featbench/conan-io__conan-17123.md) | hard |  |  | 0 |
| [conan-io__conan-17162](https://harnessreport.com/tasks/featbench/conan-io__conan-17162.md) | hard |  |  | 0 |
| [conan-io__conan-17186](https://harnessreport.com/tasks/featbench/conan-io__conan-17186.md) | hard |  |  | 0 |
| [conan-io__conan-17217](https://harnessreport.com/tasks/featbench/conan-io__conan-17217.md) | hard |  |  | 0 |
| [conan-io__conan-17300](https://harnessreport.com/tasks/featbench/conan-io__conan-17300.md) | hard |  |  | 0 |
| [conan-io__conan-17301](https://harnessreport.com/tasks/featbench/conan-io__conan-17301.md) | hard |  |  | 0 |
| [conan-io__conan-17302](https://harnessreport.com/tasks/featbench/conan-io__conan-17302.md) | hard |  |  | 0 |
| [conan-io__conan-17359](https://harnessreport.com/tasks/featbench/conan-io__conan-17359.md) | hard |  |  | 0 |
| [conan-io__conan-17377](https://harnessreport.com/tasks/featbench/conan-io__conan-17377.md) | hard |  |  | 0 |
| [conan-io__conan-17416](https://harnessreport.com/tasks/featbench/conan-io__conan-17416.md) | hard |  |  | 0 |
| [conan-io__conan-17432](https://harnessreport.com/tasks/featbench/conan-io__conan-17432.md) | hard |  |  | 0 |
| [conan-io__conan-17470](https://harnessreport.com/tasks/featbench/conan-io__conan-17470.md) | hard |  |  | 0 |
| [conan-io__conan-17507](https://harnessreport.com/tasks/featbench/conan-io__conan-17507.md) | hard |  |  | 0 |
| [conan-io__conan-17603](https://harnessreport.com/tasks/featbench/conan-io__conan-17603.md) | hard |  |  | 0 |
| [conan-io__conan-17613](https://harnessreport.com/tasks/featbench/conan-io__conan-17613.md) | hard |  |  | 0 |
| [conan-io__conan-17819](https://harnessreport.com/tasks/featbench/conan-io__conan-17819.md) | hard |  |  | 0 |
| [conan-io__conan-17838](https://harnessreport.com/tasks/featbench/conan-io__conan-17838.md) | hard |  |  | 0 |
| [conan-io__conan-17856](https://harnessreport.com/tasks/featbench/conan-io__conan-17856.md) | hard |  |  | 0 |
| [conan-io__conan-18037](https://harnessreport.com/tasks/featbench/conan-io__conan-18037.md) | hard |  |  | 0 |
| [conan-io__conan-18083](https://harnessreport.com/tasks/featbench/conan-io__conan-18083.md) | hard |  |  | 0 |
| [conan-io__conan-18101](https://harnessreport.com/tasks/featbench/conan-io__conan-18101.md) | hard |  |  | 0 |
| [conan-io__conan-18159](https://harnessreport.com/tasks/featbench/conan-io__conan-18159.md) | hard |  |  | 0 |
| [conan-io__conan-18162](https://harnessreport.com/tasks/featbench/conan-io__conan-18162.md) | hard |  |  | 0 |
| [conan-io__conan-18172](https://harnessreport.com/tasks/featbench/conan-io__conan-18172.md) | hard |  |  | 0 |
| [conan-io__conan-18219](https://harnessreport.com/tasks/featbench/conan-io__conan-18219.md) | hard |  |  | 0 |
| [conan-io__conan-18228](https://harnessreport.com/tasks/featbench/conan-io__conan-18228.md) | hard |  |  | 0 |
| [conan-io__conan-18243](https://harnessreport.com/tasks/featbench/conan-io__conan-18243.md) | hard |  |  | 0 |
| [conan-io__conan-18244](https://harnessreport.com/tasks/featbench/conan-io__conan-18244.md) | hard |  |  | 0 |
| [conan-io__conan-18246](https://harnessreport.com/tasks/featbench/conan-io__conan-18246.md) | hard |  |  | 0 |
| [conan-io__conan-18249](https://harnessreport.com/tasks/featbench/conan-io__conan-18249.md) | hard |  |  | 0 |
| [conan-io__conan-18280](https://harnessreport.com/tasks/featbench/conan-io__conan-18280.md) | hard |  |  | 0 |
| [conan-io__conan-18333](https://harnessreport.com/tasks/featbench/conan-io__conan-18333.md) | hard |  |  | 0 |
| [conan-io__conan-18383](https://harnessreport.com/tasks/featbench/conan-io__conan-18383.md) | hard |  |  | 0 |
| [conan-io__conan-18429](https://harnessreport.com/tasks/featbench/conan-io__conan-18429.md) | hard |  |  | 0 |
| [conan-io__conan-18437](https://harnessreport.com/tasks/featbench/conan-io__conan-18437.md) | hard |  |  | 0 |
| [conan-io__conan-18442](https://harnessreport.com/tasks/featbench/conan-io__conan-18442.md) | hard |  |  | 0 |
| [conan-io__conan-18489](https://harnessreport.com/tasks/featbench/conan-io__conan-18489.md) | hard |  |  | 0 |
| [conan-io__conan-18493](https://harnessreport.com/tasks/featbench/conan-io__conan-18493.md) | hard |  |  | 0 |
| [conan-io__conan-18557](https://harnessreport.com/tasks/featbench/conan-io__conan-18557.md) | hard |  |  | 0 |
| [conan-io__conan-18572](https://harnessreport.com/tasks/featbench/conan-io__conan-18572.md) | hard |  |  | 0 |
| [conan-io__conan-18578](https://harnessreport.com/tasks/featbench/conan-io__conan-18578.md) | hard |  |  | 0 |
| [conan-io__conan-18621](https://harnessreport.com/tasks/featbench/conan-io__conan-18621.md) | hard |  |  | 0 |
| [conan-io__conan-18655](https://harnessreport.com/tasks/featbench/conan-io__conan-18655.md) | hard |  |  | 0 |
| [conan-io__conan-18663](https://harnessreport.com/tasks/featbench/conan-io__conan-18663.md) | hard |  |  | 0 |
| [conan-io__conan-18676](https://harnessreport.com/tasks/featbench/conan-io__conan-18676.md) | hard |  |  | 0 |
| [dynaconf__dynaconf-1237](https://harnessreport.com/tasks/featbench/dynaconf__dynaconf-1237.md) | hard |  |  | 0 |
| [dynaconf__dynaconf-1295](https://harnessreport.com/tasks/featbench/dynaconf__dynaconf-1295.md) | hard |  |  | 0 |
| [encode__starlette-2501](https://harnessreport.com/tasks/featbench/encode__starlette-2501.md) | hard |  |  | 0 |
| [encode__starlette-2671](https://harnessreport.com/tasks/featbench/encode__starlette-2671.md) | hard |  |  | 0 |
| [encode__starlette-2732](https://harnessreport.com/tasks/featbench/encode__starlette-2732.md) | hard |  |  | 0 |
| [encode__starlette-2806](https://harnessreport.com/tasks/featbench/encode__starlette-2806.md) | hard |  |  | 0 |
| [encode__starlette-2810](https://harnessreport.com/tasks/featbench/encode__starlette-2810.md) | hard |  |  | 0 |
| [encode__starlette-2815](https://harnessreport.com/tasks/featbench/encode__starlette-2815.md) | hard |  |  | 0 |
| [fonttools__fonttools-3882](https://harnessreport.com/tasks/featbench/fonttools__fonttools-3882.md) | hard |  |  | 0 |
| [fonttools__fonttools-3894](https://harnessreport.com/tasks/featbench/fonttools__fonttools-3894.md) | hard |  |  | 0 |
| [huggingface__datasets-6931](https://harnessreport.com/tasks/featbench/huggingface__datasets-6931.md) | hard |  |  | 0 |
| [huggingface__datasets-7025](https://harnessreport.com/tasks/featbench/huggingface__datasets-7025.md) | hard |  |  | 0 |
| [huggingface__datasets-7160](https://harnessreport.com/tasks/featbench/huggingface__datasets-7160.md) | hard |  |  | 0 |
| [huggingface__datasets-7162](https://harnessreport.com/tasks/featbench/huggingface__datasets-7162.md) | hard |  |  | 0 |
| [huggingface__datasets-7170](https://harnessreport.com/tasks/featbench/huggingface__datasets-7170.md) | hard |  |  | 0 |
| [huggingface__datasets-7309](https://harnessreport.com/tasks/featbench/huggingface__datasets-7309.md) | hard |  |  | 0 |
| [huggingface__smolagents-1003](https://harnessreport.com/tasks/featbench/huggingface__smolagents-1003.md) | hard |  |  | 0 |
| [huggingface__smolagents-1104](https://harnessreport.com/tasks/featbench/huggingface__smolagents-1104.md) | hard |  |  | 0 |
| [huggingface__smolagents-1302](https://harnessreport.com/tasks/featbench/huggingface__smolagents-1302.md) | hard |  |  | 0 |
| [huggingface__smolagents-1314](https://harnessreport.com/tasks/featbench/huggingface__smolagents-1314.md) | hard |  |  | 0 |
| [huggingface__smolagents-1442](https://harnessreport.com/tasks/featbench/huggingface__smolagents-1442.md) | hard |  |  | 0 |
| [huggingface__smolagents-1517](https://harnessreport.com/tasks/featbench/huggingface__smolagents-1517.md) | hard |  |  | 0 |
| [huggingface__smolagents-1570](https://harnessreport.com/tasks/featbench/huggingface__smolagents-1570.md) | hard |  |  | 0 |
| [huggingface__smolagents-783](https://harnessreport.com/tasks/featbench/huggingface__smolagents-783.md) | hard |  |  | 0 |
| [instructlab__instructlab-2428](https://harnessreport.com/tasks/featbench/instructlab__instructlab-2428.md) | hard |  |  | 0 |
| [instructlab__instructlab-3286](https://harnessreport.com/tasks/featbench/instructlab__instructlab-3286.md) | hard |  |  | 0 |
| [iterative__dvc-10573](https://harnessreport.com/tasks/featbench/iterative__dvc-10573.md) | hard |  |  | 0 |
| [iterative__dvc-10754](https://harnessreport.com/tasks/featbench/iterative__dvc-10754.md) | hard |  |  | 0 |
| [iterative__dvc-10784](https://harnessreport.com/tasks/featbench/iterative__dvc-10784.md) | hard |  |  | 0 |
| [iterative__dvc-10798](https://harnessreport.com/tasks/featbench/iterative__dvc-10798.md) | hard |  |  | 0 |
| [jpadilla__pyjwt-886](https://harnessreport.com/tasks/featbench/jpadilla__pyjwt-886.md) | hard |  |  | 0 |
| [jpadilla__pyjwt-913](https://harnessreport.com/tasks/featbench/jpadilla__pyjwt-913.md) | hard |  |  | 0 |
| [jpadilla__pyjwt-979](https://harnessreport.com/tasks/featbench/jpadilla__pyjwt-979.md) | hard |  |  | 0 |
| [jupyterlab__jupyter-ai-986](https://harnessreport.com/tasks/featbench/jupyterlab__jupyter-ai-986.md) | hard |  |  | 0 |
| [koxudaxi__datamodel-code-generator-1945](https://harnessreport.com/tasks/featbench/koxudaxi__datamodel-code-generator-1945.md) | hard |  |  | 0 |
| [koxudaxi__datamodel-code-generator-1991](https://harnessreport.com/tasks/featbench/koxudaxi__datamodel-code-generator-1991.md) | hard |  |  | 0 |
| [koxudaxi__datamodel-code-generator-2084](https://harnessreport.com/tasks/featbench/koxudaxi__datamodel-code-generator-2084.md) | hard |  |  | 0 |
| [koxudaxi__datamodel-code-generator-2162](https://harnessreport.com/tasks/featbench/koxudaxi__datamodel-code-generator-2162.md) | hard |  |  | 0 |
| [koxudaxi__datamodel-code-generator-2165](https://harnessreport.com/tasks/featbench/koxudaxi__datamodel-code-generator-2165.md) | hard |  |  | 0 |
| [koxudaxi__datamodel-code-generator-2417](https://harnessreport.com/tasks/featbench/koxudaxi__datamodel-code-generator-2417.md) | hard |  |  | 0 |
| [koxudaxi__datamodel-code-generator-2420](https://harnessreport.com/tasks/featbench/koxudaxi__datamodel-code-generator-2420.md) | hard |  |  | 0 |
| [koxudaxi__datamodel-code-generator-2467](https://harnessreport.com/tasks/featbench/koxudaxi__datamodel-code-generator-2467.md) | hard |  |  | 0 |
| [modelcontextprotocol__python-sdk-699](https://harnessreport.com/tasks/featbench/modelcontextprotocol__python-sdk-699.md) | hard |  |  | 0 |
| [modelcontextprotocol__python-sdk-722](https://harnessreport.com/tasks/featbench/modelcontextprotocol__python-sdk-722.md) | hard |  |  | 0 |
| [openai__openai-agents-python-1080](https://harnessreport.com/tasks/featbench/openai__openai-agents-python-1080.md) | hard |  |  | 0 |
| [openai__openai-agents-python-1124](https://harnessreport.com/tasks/featbench/openai__openai-agents-python-1124.md) | hard |  |  | 0 |
| [openai__openai-agents-python-1198](https://harnessreport.com/tasks/featbench/openai__openai-agents-python-1198.md) | hard |  |  | 0 |
| [openai__openai-agents-python-1235](https://harnessreport.com/tasks/featbench/openai__openai-agents-python-1235.md) | hard |  |  | 0 |
| [openai__openai-agents-python-357](https://harnessreport.com/tasks/featbench/openai__openai-agents-python-357.md) | hard |  |  | 0 |
| [openai__openai-agents-python-508](https://harnessreport.com/tasks/featbench/openai__openai-agents-python-508.md) | hard |  |  | 0 |
| [openai__openai-agents-python-842](https://harnessreport.com/tasks/featbench/openai__openai-agents-python-842.md) | hard |  |  | 0 |
| [openai__openai-agents-python-971](https://harnessreport.com/tasks/featbench/openai__openai-agents-python-971.md) | hard |  |  | 0 |
| [projectmesa__mesa-2219](https://harnessreport.com/tasks/featbench/projectmesa__mesa-2219.md) | hard |  |  | 0 |
| [projectmesa__mesa-2253](https://harnessreport.com/tasks/featbench/projectmesa__mesa-2253.md) | hard |  |  | 0 |
| [projectmesa__mesa-2296](https://harnessreport.com/tasks/featbench/projectmesa__mesa-2296.md) | hard |  |  | 0 |
| [projectmesa__mesa-2463](https://harnessreport.com/tasks/featbench/projectmesa__mesa-2463.md) | hard |  |  | 0 |
| [projectmesa__mesa-2502](https://harnessreport.com/tasks/featbench/projectmesa__mesa-2502.md) | hard |  |  | 0 |
| [pybamm-team__PyBaMM-4073](https://harnessreport.com/tasks/featbench/pybamm-team__PyBaMM-4073.md) | hard |  |  | 0 |
| [pybamm-team__PyBaMM-4394](https://harnessreport.com/tasks/featbench/pybamm-team__PyBaMM-4394.md) | hard |  |  | 0 |
| [pybamm-team__PyBaMM-4529](https://harnessreport.com/tasks/featbench/pybamm-team__PyBaMM-4529.md) | hard |  |  | 0 |
| [pybamm-team__PyBaMM-4693](https://harnessreport.com/tasks/featbench/pybamm-team__PyBaMM-4693.md) | hard |  |  | 0 |
| [pydata__xarray-10161](https://harnessreport.com/tasks/featbench/pydata__xarray-10161.md) | hard |  |  | 0 |
| [pydata__xarray-10274](https://harnessreport.com/tasks/featbench/pydata__xarray-10274.md) | hard |  |  | 0 |
| [pydata__xarray-8840](https://harnessreport.com/tasks/featbench/pydata__xarray-8840.md) | hard |  |  | 0 |
| [pydata__xarray-9079](https://harnessreport.com/tasks/featbench/pydata__xarray-9079.md) | hard |  |  | 0 |
| [pydata__xarray-9369](https://harnessreport.com/tasks/featbench/pydata__xarray-9369.md) | hard |  |  | 0 |
| [pydata__xarray-9407](https://harnessreport.com/tasks/featbench/pydata__xarray-9407.md) | hard |  |  | 0 |
| [pydata__xarray-9526](https://harnessreport.com/tasks/featbench/pydata__xarray-9526.md) | hard |  |  | 0 |
| [pydata__xarray-9885](https://harnessreport.com/tasks/featbench/pydata__xarray-9885.md) | hard |  |  | 0 |
| [pydata__xarray-9965](https://harnessreport.com/tasks/featbench/pydata__xarray-9965.md) | hard |  |  | 0 |
| [reflex-dev__reflex-4292](https://harnessreport.com/tasks/featbench/reflex-dev__reflex-4292.md) | hard |  |  | 0 |
| [reflex-dev__reflex-4480](https://harnessreport.com/tasks/featbench/reflex-dev__reflex-4480.md) | hard |  |  | 0 |
| [reflex-dev__reflex-5401](https://harnessreport.com/tasks/featbench/reflex-dev__reflex-5401.md) | hard |  |  | 0 |
| [reflex-dev__reflex-5583](https://harnessreport.com/tasks/featbench/reflex-dev__reflex-5583.md) | hard |  |  | 0 |
| [slackapi__bolt-python-1104](https://harnessreport.com/tasks/featbench/slackapi__bolt-python-1104.md) | hard |  |  | 0 |
| [slackapi__bolt-python-1173](https://harnessreport.com/tasks/featbench/slackapi__bolt-python-1173.md) | hard |  |  | 0 |
| [slackapi__bolt-python-1187](https://harnessreport.com/tasks/featbench/slackapi__bolt-python-1187.md) | hard |  |  | 0 |
| [stanfordnlp__dspy-7872](https://harnessreport.com/tasks/featbench/stanfordnlp__dspy-7872.md) | hard |  |  | 0 |
| [stanfordnlp__dspy-7964](https://harnessreport.com/tasks/featbench/stanfordnlp__dspy-7964.md) | hard |  |  | 0 |
| [stanfordnlp__dspy-8082](https://harnessreport.com/tasks/featbench/stanfordnlp__dspy-8082.md) | hard |  |  | 0 |
| [stanfordnlp__dspy-8102](https://harnessreport.com/tasks/featbench/stanfordnlp__dspy-8102.md) | hard |  |  | 0 |
| [stanfordnlp__dspy-8110](https://harnessreport.com/tasks/featbench/stanfordnlp__dspy-8110.md) | hard |  |  | 0 |
| [stanfordnlp__dspy-8139](https://harnessreport.com/tasks/featbench/stanfordnlp__dspy-8139.md) | hard |  |  | 0 |
| [stanfordnlp__dspy-8247](https://harnessreport.com/tasks/featbench/stanfordnlp__dspy-8247.md) | hard |  |  | 0 |
| [tox-dev__tox-3288](https://harnessreport.com/tasks/featbench/tox-dev__tox-3288.md) | hard |  |  | 0 |
| [tox-dev__tox-3426](https://harnessreport.com/tasks/featbench/tox-dev__tox-3426.md) | hard |  |  | 0 |
| [tox-dev__tox-3534](https://harnessreport.com/tasks/featbench/tox-dev__tox-3534.md) | hard |  |  | 0 |

---
Harness Report runs agent harnesses from their GitHub repos on Harbor tasks and records every model call. Every page is also `.md` and `.json`; index: https://harnessreport.com/llms.txt · MCP: https://harnessreport.com/mcp