{"taskset": {"n_runnable": 0, "name": "FeatureBench", "url_data": "https://huggingface.co/datasets/LiberCoders/FeatureBench", "catalog_id": "featurebench", "owner_type": "academic", "cited_by": [], "taskset": "featurebench-lite-modal", "domain": "swe", "task_kind": "end-to-end feature implementation", "environment": "container", "grading": "tests", "path": "datasets/featurebench-lite-modal", "n_single_container": 23, "n_tasks": 30, "domain_raw": "swe", "sample_instruction": "# Task\n\n## Task\n**Task Statement: Implement Structured Unit Operations and Quantity Function Helpers**\n\n**Core Functionalities:**\n- Implement arithmetic and indexing operations for structured units (units with multiple named fields like position/velocity pairs)\n- Provide unit-aware helper functions for NumPy array operations that preserve dimensional analysis\n- Support mathematical operations (einsum, norm, concatenation) while maintaining proper unit propagation\n\n**Main Features & Requirements:**\n- Handle structured units with nested field access and multiplication/division operations\n- Convert between different unit systems while preserving structured relationships  \n- Implement array creation and manipulation functions that respect unit compatibility\n- Support element-wise operations and aggregations with proper unit handling\n- Maintain compatibility with NumPy's array function protocol\n\n**Key Challenges:**\n- Ensure unit consistency across structured fields during operations\n- Handle unit conversion and validation for complex nested structures\n- Properly propagate units through mathematical operations like matrix multiplication and tensor operations\n- Balance performance with unit safety in array operations\n- Support both simple and structured unit types in a unified interface\n\n**NOTE**: \n- This test comes from the `astropy` library, and we have given you the content of this code repository under `/testbed/`, and you need to complete based on this code repository and suppl", "owner_org": "LiberCoders", "url_repo": null, "url_paper": null, "license": "mit", "languages": [], "difficulties": {"medium": 26, "hard": 4}, "categories": ["feature"]}, "tasks": [{"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "astropy__astropy.b0db0daa.test_quantity_erfa_ufuncs.3fc54395.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "astropy__astropy.b0db0daa.test_table.48eef659.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv2"], "task": "huggingface__transformers.e2e8dbed.test_modeling_seggpt.f9e83f60.lv2", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": true, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "huggingface__transformers.e2e8dbed.test_processing_wav2vec2.4f660c78.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": true, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "huggingface__transformers.e2e8dbed.test_serve.4e7860c7.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": true, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "huggingface__transformers.e2e8dbed.test_tests_fetcher.e1abe0dd.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": true, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "huggingface__trl.02a34777.test_data_utils.827a9d15.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "lightning-ai__pytorch-lightning.126fa6f1.test_connector.825ef3b1.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "lightning-ai__pytorch-lightning.126fa6f1.test_data.c8b292af.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv2"], "task": "linkedin__liger-kernel.c856fbab.test_fused_neighborhood_attention.78217be4.lv2", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": true, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "linkedin__liger-kernel.c856fbab.test_poly_norm.7b0e3399.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "mlflow__mlflow.93dab383.test_databricks_tracing_utils.8ef44eb4.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "mlflow__mlflow.93dab383.test_judge_tool_search_traces.cad8fc4b.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "mlflow__mlflow.93dab383.test_responses_agent.072c4133.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "mlflow__mlflow.93dab383.test_serialization.2c029be6.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "mlflow__mlflow.93dab383.test_span.69efd376.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "mlflow__mlflow.93dab383.test_trace.17fde8b0.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "mlflow__mlflow.93dab383.test_validation.2e1c5076.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "mwaskom__seaborn.7001ebe7.test_algorithms.1f0181c2.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "mwaskom__seaborn.7001ebe7.test_regression.ce8c62e2.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "mwaskom__seaborn.7001ebe7.test_statistics.0f2ae277.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "netflix__metaflow.b390a8d4.test_stub_generator.7bf08c98.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "pandas-dev__pandas.82fa2715.test_concat.ebe5de39.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv2"], "task": "pandas-dev__pandas.82fa2715.test_iceberg.85771c70.lv2", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "pandas-dev__pandas.82fa2715.test_list_accessor.7ab0b2ea.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "pydantic__pydantic.e1dcaf9e.test_deprecated_fields.40a2ec54.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "pydata__xarray.97f3a746.test_backends_chunks.fa55f68a.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv2"], "task": "pydata__xarray.97f3a746.test_treenode.aa8ba777.lv2", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "sphinx-doc__sphinx.e347e59c.test_domain_c.4068b9e8.lv1", "taskset": "featurebench-lite-modal"}, {"agent_timeout": 3600, "category": "feature", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["feature", "featurebench", "lv1"], "task": "sympy__sympy.c1097516.test_nullspace.f14fc970.lv1", "taskset": "featurebench-lite-modal"}], "next": null}