{"taskset": {"n_runnable": 0, "name": "SWE-Lancer", "url_data": null, "catalog_id": "swe-lancer", "owner_type": "lab", "cited_by": ["inspect_evals"], "taskset": "swe-lancer", "domain": "swe", "task_kind": "IC SWE patches + SWE-manager proposal selection, priced in USD", "environment": "container", "grading": "tests", "path": "datasets/swe-lancer", "n_single_container": 0, "n_tasks": 463, "domain_raw": "freelance software engineering (Expensify/Upwork)", "sample_instruction": "  You are an expert software engineer maintaining the Expensify repository. It has already been cloned, and is present in /app/expensify (your CWD). You have been tasked with fixing the following issue:\n\n  <title>\n  [HOLD for payment 2023-02-03] [$4000] Chat - The Paragraphs are not displayed and some spaces missing between text after copied test from the opened HTML file\n  </title>\n\n  <description>\n  If you haven\u2019t already, check out our [contributing guidelines](https://github.com/Expensify/ReactNativeChat/blob/main/contributingGuides/CONTRIBUTING.md) for onboarding and email contributors@expensify.com to request to join our Slack channel!\n  ___\n\n  **Issue found when executing PR** https://github.com/Expensify/App/pull/11926\n\n  ## Action Performed:\n  1. Go to staging.new.expensify.com\n  2. Log in with any account\n  3. Select any chat\n  4. Open HTML file in another tab\n  5. Copy and paste as is\n  6. Send it\n\n  ## Expected Result:\n  The Paragraphs and spaces between text are displayed after  copied test from the opened HTML file\n\n  ## Actual Result:\n  The Paragraphs are not displayed and some spaces missing between text after copied test from the opened HTML file\n\n  ## Workaround:\n  Unknown\n\n  ## Platform:\n  <!---\n  Remove any platforms that aren't affected by this issue\n  --->\n  Where is this issue occurring?\n\n  - Web\n  - iOS\n  - Android\n  - Desktop App\n  - Mobile Web\n\n  **Version Number:** 1.2.19.2\n\n  **Reproducible in staging?:** Yes\n\n  **Reproducible in production?:** Yes", "owner_org": "OpenAI", "url_repo": "https://github.com/openai/SWELancer-Benchmark", "url_paper": "https://arxiv.org/abs/2502.12115", "license": null, "languages": [], "difficulties": {"hard": 463}, "categories": ["debugging"]}, "tasks": [{"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "12155-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "12155_1", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "13006-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "13066_1", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "14127", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "14223_1", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "14268", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "14268-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "14294", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "14294-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "14340", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "14857", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "14958", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "14958-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "15048-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "15108", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "15193", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "15193-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "15289-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "15289_1", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "15321", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "15784-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "15815-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "15815_1", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "15925", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "16912-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "16912_4", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "16921-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "16921_1", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "16935-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "16946-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "16977-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "16985-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "17073-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "17092-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "17155-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "17163-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "17166-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "17187-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "17387-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "17387_1", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18157-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18157_893", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18207-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18207_923", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18218-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18230_905", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18244-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18300-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18311-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18434-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18447-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18535-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18569-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18641_837", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18647-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18647_838", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18658-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18659_831", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18660_869", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18667-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18681-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18688-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18736-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18742-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18746_833", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18796-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18813-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18827-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18827_741", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18836-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18891_881", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18909-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18909_734", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18910-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18910_733", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18911-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "18983-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19022-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19022_888", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19023_868", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19048-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19073-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19132-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19132_872", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19135-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19135_873", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19167-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19232-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19289-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19301-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19359-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19362_850", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19364-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19366-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19398-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "19398_889", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "20079", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "20569-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "20569_1122", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "20589-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "20608-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "20672-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "20672_1019", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "20675-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "20703_962", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "22624", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24145-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24145_783", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24155-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24156-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24157-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24237-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24261-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24263-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24366-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24368-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24393-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24476-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24508-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24508_791", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24522-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24642-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "24654-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25405-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25448-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25491-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25495-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25499-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25527-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25550-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25562-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25570-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25570_780", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25577-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25582-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25589-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25595-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25640-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25640_655", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25646-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25693-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25859-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25901-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25901_945", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25929-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25932-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "25975-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "26009-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "26015-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "26048-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "26120-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "26161_924", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "26167-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "26209-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "26210-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "26228-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "26228_719", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "26258-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "26258_492", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "26648-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "26648_972", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27029-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27029_876", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27092-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27106-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27107-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27114-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27153-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27156-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27156_665", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27226_729", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27243-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27243_705", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27353_776", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27363_760", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27538-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "27538_794", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28019-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28030-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28030_832", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28059_803", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28077-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28077_782", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28087-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28087_800", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28093-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28093_799", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28096_836", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28132-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28148_414", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28153-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28153_817", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28170-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28250-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28250_990", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28265-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28265_616", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28324-manager-0", "taskset": "swe-lancer"}, {"agent_timeout": 3000, "category": "debugging", "compose": true, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": [], "task": "28324_808", "taskset": "swe-lancer"}], "next": "28324_808"}