# featurebench-lite - domain: swe - n_tasks: 30 - n_runnable: 0 - owner_org: LiberCoders - grading: tests - task_kind: end-to-end feature implementation ## Tasks | task | difficulty | language | runnable | harnesses tried | |---|---|---|---|---| | [astropy__astropy.b0db0daa.test_quantity_erfa_ufuncs.3fc54395.lv1](https://harnessreport.com/tasks/featurebench-lite/astropy__astropy.b0db0daa.test_quantity_erfa_ufuncs.3fc54395.lv1.md) | medium | | | 0 | | [astropy__astropy.b0db0daa.test_table.48eef659.lv1](https://harnessreport.com/tasks/featurebench-lite/astropy__astropy.b0db0daa.test_table.48eef659.lv1.md) | medium | | | 0 | | [huggingface__transformers.e2e8dbed.test_modeling_seggpt.f9e83f60.lv2](https://harnessreport.com/tasks/featurebench-lite/huggingface__transformers.e2e8dbed.test_modeling_seggpt.f9e83f60.lv2.md) | hard | | | 0 | | [huggingface__transformers.e2e8dbed.test_processing_wav2vec2.4f660c78.lv1](https://harnessreport.com/tasks/featurebench-lite/huggingface__transformers.e2e8dbed.test_processing_wav2vec2.4f660c78.lv1.md) | medium | | | 0 | | [huggingface__transformers.e2e8dbed.test_serve.4e7860c7.lv1](https://harnessreport.com/tasks/featurebench-lite/huggingface__transformers.e2e8dbed.test_serve.4e7860c7.lv1.md) | medium | | | 0 | | [huggingface__transformers.e2e8dbed.test_tests_fetcher.e1abe0dd.lv1](https://harnessreport.com/tasks/featurebench-lite/huggingface__transformers.e2e8dbed.test_tests_fetcher.e1abe0dd.lv1.md) | medium | | | 0 | | [huggingface__trl.02a34777.test_data_utils.827a9d15.lv1](https://harnessreport.com/tasks/featurebench-lite/huggingface__trl.02a34777.test_data_utils.827a9d15.lv1.md) | medium | | | 0 | | [lightning-ai__pytorch-lightning.126fa6f1.test_connector.825ef3b1.lv1](https://harnessreport.com/tasks/featurebench-lite/lightning-ai__pytorch-lightning.126fa6f1.test_connector.825ef3b1.lv1.md) | medium | | | 0 | | [lightning-ai__pytorch-lightning.126fa6f1.test_data.c8b292af.lv1](https://harnessreport.com/tasks/featurebench-lite/lightning-ai__pytorch-lightning.126fa6f1.test_data.c8b292af.lv1.md) | medium | | | 0 | | [linkedin__liger-kernel.c856fbab.test_fused_neighborhood_attention.78217be4.lv2](https://harnessreport.com/tasks/featurebench-lite/linkedin__liger-kernel.c856fbab.test_fused_neighborhood_attention.78217be4.lv2.md) | hard | | | 0 | | [linkedin__liger-kernel.c856fbab.test_poly_norm.7b0e3399.lv1](https://harnessreport.com/tasks/featurebench-lite/linkedin__liger-kernel.c856fbab.test_poly_norm.7b0e3399.lv1.md) | medium | | | 0 | | [mlflow__mlflow.93dab383.test_databricks_tracing_utils.8ef44eb4.lv1](https://harnessreport.com/tasks/featurebench-lite/mlflow__mlflow.93dab383.test_databricks_tracing_utils.8ef44eb4.lv1.md) | medium | | | 0 | | [mlflow__mlflow.93dab383.test_judge_tool_search_traces.cad8fc4b.lv1](https://harnessreport.com/tasks/featurebench-lite/mlflow__mlflow.93dab383.test_judge_tool_search_traces.cad8fc4b.lv1.md) | medium | | | 0 | | [mlflow__mlflow.93dab383.test_responses_agent.072c4133.lv1](https://harnessreport.com/tasks/featurebench-lite/mlflow__mlflow.93dab383.test_responses_agent.072c4133.lv1.md) | medium | | | 0 | | [mlflow__mlflow.93dab383.test_serialization.2c029be6.lv1](https://harnessreport.com/tasks/featurebench-lite/mlflow__mlflow.93dab383.test_serialization.2c029be6.lv1.md) | medium | | | 0 | | [mlflow__mlflow.93dab383.test_span.69efd376.lv1](https://harnessreport.com/tasks/featurebench-lite/mlflow__mlflow.93dab383.test_span.69efd376.lv1.md) | medium | | | 0 | | [mlflow__mlflow.93dab383.test_trace.17fde8b0.lv1](https://harnessreport.com/tasks/featurebench-lite/mlflow__mlflow.93dab383.test_trace.17fde8b0.lv1.md) | medium | | | 0 | | [mlflow__mlflow.93dab383.test_validation.2e1c5076.lv1](https://harnessreport.com/tasks/featurebench-lite/mlflow__mlflow.93dab383.test_validation.2e1c5076.lv1.md) | medium | | | 0 | | [mwaskom__seaborn.7001ebe7.test_algorithms.1f0181c2.lv1](https://harnessreport.com/tasks/featurebench-lite/mwaskom__seaborn.7001ebe7.test_algorithms.1f0181c2.lv1.md) | medium | | | 0 | | [mwaskom__seaborn.7001ebe7.test_regression.ce8c62e2.lv1](https://harnessreport.com/tasks/featurebench-lite/mwaskom__seaborn.7001ebe7.test_regression.ce8c62e2.lv1.md) | medium | | | 0 | | [mwaskom__seaborn.7001ebe7.test_statistics.0f2ae277.lv1](https://harnessreport.com/tasks/featurebench-lite/mwaskom__seaborn.7001ebe7.test_statistics.0f2ae277.lv1.md) | medium | | | 0 | | [netflix__metaflow.b390a8d4.test_stub_generator.7bf08c98.lv1](https://harnessreport.com/tasks/featurebench-lite/netflix__metaflow.b390a8d4.test_stub_generator.7bf08c98.lv1.md) | medium | | | 0 | | [pandas-dev__pandas.82fa2715.test_concat.ebe5de39.lv1](https://harnessreport.com/tasks/featurebench-lite/pandas-dev__pandas.82fa2715.test_concat.ebe5de39.lv1.md) | medium | | | 0 | | [pandas-dev__pandas.82fa2715.test_iceberg.85771c70.lv2](https://harnessreport.com/tasks/featurebench-lite/pandas-dev__pandas.82fa2715.test_iceberg.85771c70.lv2.md) | hard | | | 0 | | [pandas-dev__pandas.82fa2715.test_list_accessor.7ab0b2ea.lv1](https://harnessreport.com/tasks/featurebench-lite/pandas-dev__pandas.82fa2715.test_list_accessor.7ab0b2ea.lv1.md) | medium | | | 0 | | [pydantic__pydantic.e1dcaf9e.test_deprecated_fields.40a2ec54.lv1](https://harnessreport.com/tasks/featurebench-lite/pydantic__pydantic.e1dcaf9e.test_deprecated_fields.40a2ec54.lv1.md) | medium | | | 0 | | [pydata__xarray.97f3a746.test_backends_chunks.fa55f68a.lv1](https://harnessreport.com/tasks/featurebench-lite/pydata__xarray.97f3a746.test_backends_chunks.fa55f68a.lv1.md) | medium | | | 0 | | [pydata__xarray.97f3a746.test_treenode.aa8ba777.lv2](https://harnessreport.com/tasks/featurebench-lite/pydata__xarray.97f3a746.test_treenode.aa8ba777.lv2.md) | hard | | | 0 | | [sphinx-doc__sphinx.e347e59c.test_domain_c.4068b9e8.lv1](https://harnessreport.com/tasks/featurebench-lite/sphinx-doc__sphinx.e347e59c.test_domain_c.4068b9e8.lv1.md) | medium | | | 0 | | [sympy__sympy.c1097516.test_nullspace.f14fc970.lv1](https://harnessreport.com/tasks/featurebench-lite/sympy__sympy.c1097516.test_nullspace.f14fc970.lv1.md) | medium | | | 0 | --- Harness Report runs agent harnesses from their GitHub repos on Harbor tasks and records every model call. Every page is also `.md` and `.json`; index: https://harnessreport.com/llms.txt · MCP: https://harnessreport.com/mcp