{"taskset": {"n_runnable": 3, "name": "SWE-bench Verified", "url_data": "https://huggingface.co/datasets/princeton-nlp/SWE-bench_Verified", "catalog_id": "swe-bench-verified", "owner_type": "community", "cited_by": ["Claude Sonnet 5", "GLM-5", "Gemini 3.1 Pro card", "Kimi K2.6", "MiniMax M3", "Mistral Medium 3.5", "Nemotron 3 Ultra", "Nemotron 3.5 Lightning", "everyone; Epoch AI hub"], "taskset": "swebench-verified", "domain": "swe", "task_kind": "resolve real GitHub issues in Python repos", "environment": "container", "grading": "tests", "path": "datasets/swebench-verified", "n_single_container": 500, "n_tasks": 500, "domain_raw": "swe", "sample_instruction": "Modeling's `separability_matrix` does not compute separability correctly for nested CompoundModels\nConsider the following model:\n\n```python\nfrom astropy.modeling import models as m\nfrom astropy.modeling.separable import separability_matrix\n\ncm = m.Linear1D(10) & m.Linear1D(5)\n```\n\nIt's separability matrix as you might expect is a diagonal:\n\n```python\n>>> separability_matrix(cm)\narray([[ True, False],\n       [False,  True]])\n```\n\nIf I make the model more complex:\n```python\n>>> separability_matrix(m.Pix2Sky_TAN() & m.Linear1D(10) & m.Linear1D(5))\narray([[ True,  True, False, False],\n       [ True,  True, False, False],\n       [False, False,  True, False],\n       [False, False, False,  True]])\n```\n\nThe output matrix is again, as expected, the outputs and inputs to the linear models are separable and independent of each other.\n\nIf however, I nest these compound models:\n```python\n>>> separability_matrix(m.Pix2Sky_TAN() & cm)\narray([[ True,  True, False, False],\n       [ True,  True, False, False],\n       [False, False,  True,  True],\n       [False, False,  True,  True]])\n```\nSuddenly the inputs and outputs are no longer separable?\n\nThis feels like a bug to me, but I might be missing something?\n", "owner_org": "OpenAI & SWE-bench team (Princeton/Stanford)", "url_repo": "https://github.com/SWE-bench/SWE-bench", "url_paper": "https://arxiv.org/abs/2310.06770", "license": "MIT", "languages": [], "difficulties": {">4 hours": 3, "1-4 hours": 42, "<15 min fix": 194, "15 min - 1 hour": 261}, "categories": ["debugging"]}, "tasks": [{"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-12907", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-13033", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-13236", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-13398", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-13453", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-13579", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-13977", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-14096", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-14182", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-14309", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-14365", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-14369", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-14508", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-14539", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-14598", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-14995", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-7166", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-7336", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-7606", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-7671", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-8707", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "astropy__astropy-8872", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-10097", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-10554", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-10880", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-10914", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-10973", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-10999", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11066", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11087", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11095", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11099", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11119", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11133", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11138", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11141", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11149", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11163", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11179", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11206", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11211", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11239", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11265", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11276", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11292", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11299", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11333", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11400", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11433", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11451", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11477", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11490", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11532", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11551", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11555", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11603", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11728", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11734", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11740", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11749", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11790", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11815", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11820", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11848", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11880", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11885", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11951", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11964", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-11999", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12039", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12050", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12125", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12143", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12155", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12193", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12209", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12262", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12273", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12276", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12304", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12308", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12325", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12406", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12419", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12663", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12708", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12713", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12741", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12754", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12774", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12858", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-12965", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13012", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13023", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13028", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13033", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13089", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13109", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13112", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13121", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13128", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13158", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13195", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13212", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13279", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13297", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13315", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13343", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13344", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13346", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13363", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13401", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13406", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13410", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13417", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13449", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13512", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13513", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13516", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13551", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13568", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13569", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13590", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13658", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13670", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13741", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13786", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13794", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13807", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13809", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13810", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13820", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13821", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13837", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13925", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13933", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-13964", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14007", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14011", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14017", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14034", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14053", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14089", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14122", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14140", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14155", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14170", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14238", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14311", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14315", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14349", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14351", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14373", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14376", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14404", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14434", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14493", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14500", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14534", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14539", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14559", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14580", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14608", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14631", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14672", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14725", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14752", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14765", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14771", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14787", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14792", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14855", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14915", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-14999", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15022", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15037", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15098", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15103", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15104", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15127", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15128", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15161", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15252", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15268", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15277", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15278", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15280", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15315", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15368", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15375", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15380", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15382", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15467", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15499", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "1-4 hours", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15503", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15525", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15554", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15561", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "15 min - 1 hour", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15563", "taskset": "swebench-verified"}, {"agent_timeout": 3000, "category": "debugging", "compose": false, "difficulty": "<15 min fix", "language": "", "oracle": null, "runnable": false, "tags": ["debugging", "swe-bench"], "task": "django__django-15569", "taskset": "swebench-verified"}], "next": "django__django-15569"}