{"taskset": {"n_runnable": 0, "name": null, "url_data": null, "catalog_id": null, "owner_type": null, "cited_by": null, "taskset": "autocodebench", "domain": "swe", "task_kind": null, "environment": null, "grading": null, "path": "datasets/autocodebench", "n_single_container": 200, "n_tasks": 200, "domain_raw": null, "sample_instruction": "Solve the problem and write ONLY the final code to `solution.txt`.\nDo not include code fences, tests, commands, or commentary.\n\n# 3D Shape Analyzer Problem\n\n## Problem Description\nYou are tasked with implementing a `ShapeAnalyzer` class that can analyze 3D shapes represented as 2D grids of cube heights. Each cell in the grid represents a stack of cubes, where the integer value indicates how many cubes are stacked at that position. The class should be able to calculate various properties of the shape including surface area, volume, contact area between adjacent cubes, and bounding box dimensions.\n\n## Class Requirements\nImplement a class called `ShapeAnalyzer` with the following public member functions:\n\n1. `int calculateSurfaceArea(const vector<vector<int>>& grid)`\n   - Calculates the total visible surface area of all cubes in the grid\n   - Counts all faces that are not touching another cube or the base\n\n2. `int calculateVolume(const vector<vector<int>>& grid)`\n   - Calculates the total volume of the shape (sum of all cube heights)\n\n3. `vector<int> calculateBoundingBox(const vector<vector<int>>& grid)`\n   - Returns the dimensions of the smallest rectangular prism that could contain the shape\n   - Format: {length (rows), width (columns), height (max cube height)}\n\n4. `int calculateContactArea(const vector<vector<int>>& grid)`\n   - Calculates the total area where cubes touch each other (adjacent faces)\n\n5. `map<string, int> analyzeShape(const vector<vector<int>>& grid)`\n   - Ret", "owner_org": null, "url_repo": null, "url_paper": null, "license": null, "languages": ["cpp", "csharp", "dart", "elixir", "go", "java", "javascript", "julia", "kotlin", "perl", "php", "python", "r", "racket", "ruby", "rust", "scala", "shell", "swift", "typescript"], "difficulties": {"easy": 27, "hard": 127, "medium": 46}, "categories": ["coding"]}, "tasks": [{"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "cpp", "oracle": null, "runnable": false, "tags": ["autocodebench", "cpp"], "task": "cpp_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "cpp", "oracle": null, "runnable": false, "tags": ["autocodebench", "cpp"], "task": "cpp_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "cpp", "oracle": null, "runnable": false, "tags": ["autocodebench", "cpp"], "task": "cpp_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "cpp", "oracle": null, "runnable": false, "tags": ["autocodebench", "cpp"], "task": "cpp_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "cpp", "oracle": null, "runnable": false, "tags": ["autocodebench", "cpp"], "task": "cpp_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "cpp", "oracle": null, "runnable": false, "tags": ["autocodebench", "cpp"], "task": "cpp_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "cpp", "oracle": null, "runnable": false, "tags": ["autocodebench", "cpp"], "task": "cpp_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "cpp", "oracle": null, "runnable": false, "tags": ["autocodebench", "cpp"], "task": "cpp_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "cpp", "oracle": null, "runnable": false, "tags": ["autocodebench", "cpp"], "task": "cpp_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "cpp", "oracle": null, "runnable": false, "tags": ["autocodebench", "cpp"], "task": "cpp_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "csharp", "oracle": null, "runnable": false, "tags": ["autocodebench", "csharp"], "task": "csharp_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "csharp", "oracle": null, "runnable": false, "tags": ["autocodebench", "csharp"], "task": "csharp_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "csharp", "oracle": null, "runnable": false, "tags": ["autocodebench", "csharp"], "task": "csharp_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "csharp", "oracle": null, "runnable": false, "tags": ["autocodebench", "csharp"], "task": "csharp_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "csharp", "oracle": null, "runnable": false, "tags": ["autocodebench", "csharp"], "task": "csharp_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "csharp", "oracle": null, "runnable": false, "tags": ["autocodebench", "csharp"], "task": "csharp_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "csharp", "oracle": null, "runnable": false, "tags": ["autocodebench", "csharp"], "task": "csharp_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "csharp", "oracle": null, "runnable": false, "tags": ["autocodebench", "csharp"], "task": "csharp_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "csharp", "oracle": null, "runnable": false, "tags": ["autocodebench", "csharp"], "task": "csharp_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "csharp", "oracle": null, "runnable": false, "tags": ["autocodebench", "csharp"], "task": "csharp_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "dart", "oracle": null, "runnable": false, "tags": ["autocodebench", "dart"], "task": "dart_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "dart", "oracle": null, "runnable": false, "tags": ["autocodebench", "dart"], "task": "dart_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "dart", "oracle": null, "runnable": false, "tags": ["autocodebench", "dart"], "task": "dart_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "dart", "oracle": null, "runnable": false, "tags": ["autocodebench", "dart"], "task": "dart_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "dart", "oracle": null, "runnable": false, "tags": ["autocodebench", "dart"], "task": "dart_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "dart", "oracle": null, "runnable": false, "tags": ["autocodebench", "dart"], "task": "dart_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "dart", "oracle": null, "runnable": false, "tags": ["autocodebench", "dart"], "task": "dart_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "dart", "oracle": null, "runnable": false, "tags": ["autocodebench", "dart"], "task": "dart_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "dart", "oracle": null, "runnable": false, "tags": ["autocodebench", "dart"], "task": "dart_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "dart", "oracle": null, "runnable": false, "tags": ["autocodebench", "dart"], "task": "dart_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "elixir", "oracle": null, "runnable": false, "tags": ["autocodebench", "elixir"], "task": "elixir_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "elixir", "oracle": null, "runnable": false, "tags": ["autocodebench", "elixir"], "task": "elixir_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "elixir", "oracle": null, "runnable": false, "tags": ["autocodebench", "elixir"], "task": "elixir_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "elixir", "oracle": null, "runnable": false, "tags": ["autocodebench", "elixir"], "task": "elixir_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "elixir", "oracle": null, "runnable": false, "tags": ["autocodebench", "elixir"], "task": "elixir_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "elixir", "oracle": null, "runnable": false, "tags": ["autocodebench", "elixir"], "task": "elixir_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "elixir", "oracle": null, "runnable": false, "tags": ["autocodebench", "elixir"], "task": "elixir_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "elixir", "oracle": null, "runnable": false, "tags": ["autocodebench", "elixir"], "task": "elixir_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "elixir", "oracle": null, "runnable": false, "tags": ["autocodebench", "elixir"], "task": "elixir_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "elixir", "oracle": null, "runnable": false, "tags": ["autocodebench", "elixir"], "task": "elixir_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "go", "oracle": null, "runnable": false, "tags": ["autocodebench", "go"], "task": "go_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "go", "oracle": null, "runnable": false, "tags": ["autocodebench", "go"], "task": "go_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "go", "oracle": null, "runnable": false, "tags": ["autocodebench", "go"], "task": "go_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "go", "oracle": null, "runnable": false, "tags": ["autocodebench", "go"], "task": "go_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "go", "oracle": null, "runnable": false, "tags": ["autocodebench", "go"], "task": "go_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "go", "oracle": null, "runnable": false, "tags": ["autocodebench", "go"], "task": "go_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "go", "oracle": null, "runnable": false, "tags": ["autocodebench", "go"], "task": "go_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "go", "oracle": null, "runnable": false, "tags": ["autocodebench", "go"], "task": "go_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "go", "oracle": null, "runnable": false, "tags": ["autocodebench", "go"], "task": "go_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "go", "oracle": null, "runnable": false, "tags": ["autocodebench", "go"], "task": "go_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "java", "oracle": null, "runnable": false, "tags": ["autocodebench", "java"], "task": "java_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "java", "oracle": null, "runnable": false, "tags": ["autocodebench", "java"], "task": "java_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "java", "oracle": null, "runnable": false, "tags": ["autocodebench", "java"], "task": "java_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "java", "oracle": null, "runnable": false, "tags": ["autocodebench", "java"], "task": "java_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "java", "oracle": null, "runnable": false, "tags": ["autocodebench", "java"], "task": "java_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "java", "oracle": null, "runnable": false, "tags": ["autocodebench", "java"], "task": "java_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "java", "oracle": null, "runnable": false, "tags": ["autocodebench", "java"], "task": "java_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "java", "oracle": null, "runnable": false, "tags": ["autocodebench", "java"], "task": "java_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "java", "oracle": null, "runnable": false, "tags": ["autocodebench", "java"], "task": "java_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "java", "oracle": null, "runnable": false, "tags": ["autocodebench", "java"], "task": "java_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "javascript", "oracle": null, "runnable": false, "tags": ["autocodebench", "javascript"], "task": "javascript_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "javascript", "oracle": null, "runnable": false, "tags": ["autocodebench", "javascript"], "task": "javascript_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "javascript", "oracle": null, "runnable": false, "tags": ["autocodebench", "javascript"], "task": "javascript_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "javascript", "oracle": null, "runnable": false, "tags": ["autocodebench", "javascript"], "task": "javascript_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "javascript", "oracle": null, "runnable": false, "tags": ["autocodebench", "javascript"], "task": "javascript_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "javascript", "oracle": null, "runnable": false, "tags": ["autocodebench", "javascript"], "task": "javascript_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "javascript", "oracle": null, "runnable": false, "tags": ["autocodebench", "javascript"], "task": "javascript_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "javascript", "oracle": null, "runnable": false, "tags": ["autocodebench", "javascript"], "task": "javascript_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "javascript", "oracle": null, "runnable": false, "tags": ["autocodebench", "javascript"], "task": "javascript_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "javascript", "oracle": null, "runnable": false, "tags": ["autocodebench", "javascript"], "task": "javascript_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "julia", "oracle": null, "runnable": false, "tags": ["autocodebench", "julia"], "task": "julia_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "julia", "oracle": null, "runnable": false, "tags": ["autocodebench", "julia"], "task": "julia_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "julia", "oracle": null, "runnable": false, "tags": ["autocodebench", "julia"], "task": "julia_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "julia", "oracle": null, "runnable": false, "tags": ["autocodebench", "julia"], "task": "julia_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "julia", "oracle": null, "runnable": false, "tags": ["autocodebench", "julia"], "task": "julia_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "julia", "oracle": null, "runnable": false, "tags": ["autocodebench", "julia"], "task": "julia_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "julia", "oracle": null, "runnable": false, "tags": ["autocodebench", "julia"], "task": "julia_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "julia", "oracle": null, "runnable": false, "tags": ["autocodebench", "julia"], "task": "julia_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "julia", "oracle": null, "runnable": false, "tags": ["autocodebench", "julia"], "task": "julia_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "julia", "oracle": null, "runnable": false, "tags": ["autocodebench", "julia"], "task": "julia_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "kotlin", "oracle": null, "runnable": false, "tags": ["autocodebench", "kotlin"], "task": "kotlin_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "kotlin", "oracle": null, "runnable": false, "tags": ["autocodebench", "kotlin"], "task": "kotlin_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "kotlin", "oracle": null, "runnable": false, "tags": ["autocodebench", "kotlin"], "task": "kotlin_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "kotlin", "oracle": null, "runnable": false, "tags": ["autocodebench", "kotlin"], "task": "kotlin_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "kotlin", "oracle": null, "runnable": false, "tags": ["autocodebench", "kotlin"], "task": "kotlin_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "kotlin", "oracle": null, "runnable": false, "tags": ["autocodebench", "kotlin"], "task": "kotlin_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "kotlin", "oracle": null, "runnable": false, "tags": ["autocodebench", "kotlin"], "task": "kotlin_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "kotlin", "oracle": null, "runnable": false, "tags": ["autocodebench", "kotlin"], "task": "kotlin_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "kotlin", "oracle": null, "runnable": false, "tags": ["autocodebench", "kotlin"], "task": "kotlin_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "kotlin", "oracle": null, "runnable": false, "tags": ["autocodebench", "kotlin"], "task": "kotlin_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "perl", "oracle": null, "runnable": false, "tags": ["autocodebench", "perl"], "task": "perl_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "perl", "oracle": null, "runnable": false, "tags": ["autocodebench", "perl"], "task": "perl_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "perl", "oracle": null, "runnable": false, "tags": ["autocodebench", "perl"], "task": "perl_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "perl", "oracle": null, "runnable": false, "tags": ["autocodebench", "perl"], "task": "perl_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "perl", "oracle": null, "runnable": false, "tags": ["autocodebench", "perl"], "task": "perl_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "perl", "oracle": null, "runnable": false, "tags": ["autocodebench", "perl"], "task": "perl_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "perl", "oracle": null, "runnable": false, "tags": ["autocodebench", "perl"], "task": "perl_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "perl", "oracle": null, "runnable": false, "tags": ["autocodebench", "perl"], "task": "perl_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "perl", "oracle": null, "runnable": false, "tags": ["autocodebench", "perl"], "task": "perl_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "perl", "oracle": null, "runnable": false, "tags": ["autocodebench", "perl"], "task": "perl_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "php", "oracle": null, "runnable": false, "tags": ["autocodebench", "php"], "task": "php_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "php", "oracle": null, "runnable": false, "tags": ["autocodebench", "php"], "task": "php_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "php", "oracle": null, "runnable": false, "tags": ["autocodebench", "php"], "task": "php_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "php", "oracle": null, "runnable": false, "tags": ["autocodebench", "php"], "task": "php_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "php", "oracle": null, "runnable": false, "tags": ["autocodebench", "php"], "task": "php_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "php", "oracle": null, "runnable": false, "tags": ["autocodebench", "php"], "task": "php_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "php", "oracle": null, "runnable": false, "tags": ["autocodebench", "php"], "task": "php_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "php", "oracle": null, "runnable": false, "tags": ["autocodebench", "php"], "task": "php_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "php", "oracle": null, "runnable": false, "tags": ["autocodebench", "php"], "task": "php_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "php", "oracle": null, "runnable": false, "tags": ["autocodebench", "php"], "task": "php_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "python", "oracle": null, "runnable": false, "tags": ["autocodebench", "python"], "task": "python_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "python", "oracle": null, "runnable": false, "tags": ["autocodebench", "python"], "task": "python_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "python", "oracle": null, "runnable": false, "tags": ["autocodebench", "python"], "task": "python_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "python", "oracle": null, "runnable": false, "tags": ["autocodebench", "python"], "task": "python_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "python", "oracle": null, "runnable": false, "tags": ["autocodebench", "python"], "task": "python_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "python", "oracle": null, "runnable": false, "tags": ["autocodebench", "python"], "task": "python_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "python", "oracle": null, "runnable": false, "tags": ["autocodebench", "python"], "task": "python_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "python", "oracle": null, "runnable": false, "tags": ["autocodebench", "python"], "task": "python_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "python", "oracle": null, "runnable": false, "tags": ["autocodebench", "python"], "task": "python_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "python", "oracle": null, "runnable": false, "tags": ["autocodebench", "python"], "task": "python_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "r", "oracle": null, "runnable": false, "tags": ["autocodebench", "r"], "task": "r_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "r", "oracle": null, "runnable": false, "tags": ["autocodebench", "r"], "task": "r_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "r", "oracle": null, "runnable": false, "tags": ["autocodebench", "r"], "task": "r_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "r", "oracle": null, "runnable": false, "tags": ["autocodebench", "r"], "task": "r_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "r", "oracle": null, "runnable": false, "tags": ["autocodebench", "r"], "task": "r_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "r", "oracle": null, "runnable": false, "tags": ["autocodebench", "r"], "task": "r_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "r", "oracle": null, "runnable": false, "tags": ["autocodebench", "r"], "task": "r_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "r", "oracle": null, "runnable": false, "tags": ["autocodebench", "r"], "task": "r_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "r", "oracle": null, "runnable": false, "tags": ["autocodebench", "r"], "task": "r_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "r", "oracle": null, "runnable": false, "tags": ["autocodebench", "r"], "task": "r_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "racket", "oracle": null, "runnable": false, "tags": ["autocodebench", "racket"], "task": "racket_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "racket", "oracle": null, "runnable": false, "tags": ["autocodebench", "racket"], "task": "racket_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "racket", "oracle": null, "runnable": false, "tags": ["autocodebench", "racket"], "task": "racket_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "racket", "oracle": null, "runnable": false, "tags": ["autocodebench", "racket"], "task": "racket_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "racket", "oracle": null, "runnable": false, "tags": ["autocodebench", "racket"], "task": "racket_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "racket", "oracle": null, "runnable": false, "tags": ["autocodebench", "racket"], "task": "racket_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "racket", "oracle": null, "runnable": false, "tags": ["autocodebench", "racket"], "task": "racket_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "racket", "oracle": null, "runnable": false, "tags": ["autocodebench", "racket"], "task": "racket_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "racket", "oracle": null, "runnable": false, "tags": ["autocodebench", "racket"], "task": "racket_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "racket", "oracle": null, "runnable": false, "tags": ["autocodebench", "racket"], "task": "racket_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "ruby", "oracle": null, "runnable": false, "tags": ["autocodebench", "ruby"], "task": "ruby_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "ruby", "oracle": null, "runnable": false, "tags": ["autocodebench", "ruby"], "task": "ruby_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "ruby", "oracle": null, "runnable": false, "tags": ["autocodebench", "ruby"], "task": "ruby_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "ruby", "oracle": null, "runnable": false, "tags": ["autocodebench", "ruby"], "task": "ruby_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "ruby", "oracle": null, "runnable": false, "tags": ["autocodebench", "ruby"], "task": "ruby_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "ruby", "oracle": null, "runnable": false, "tags": ["autocodebench", "ruby"], "task": "ruby_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "ruby", "oracle": null, "runnable": false, "tags": ["autocodebench", "ruby"], "task": "ruby_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "ruby", "oracle": null, "runnable": false, "tags": ["autocodebench", "ruby"], "task": "ruby_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "ruby", "oracle": null, "runnable": false, "tags": ["autocodebench", "ruby"], "task": "ruby_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "ruby", "oracle": null, "runnable": false, "tags": ["autocodebench", "ruby"], "task": "ruby_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "rust", "oracle": null, "runnable": false, "tags": ["autocodebench", "rust"], "task": "rust_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "rust", "oracle": null, "runnable": false, "tags": ["autocodebench", "rust"], "task": "rust_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "rust", "oracle": null, "runnable": false, "tags": ["autocodebench", "rust"], "task": "rust_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "rust", "oracle": null, "runnable": false, "tags": ["autocodebench", "rust"], "task": "rust_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "rust", "oracle": null, "runnable": false, "tags": ["autocodebench", "rust"], "task": "rust_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "rust", "oracle": null, "runnable": false, "tags": ["autocodebench", "rust"], "task": "rust_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "rust", "oracle": null, "runnable": false, "tags": ["autocodebench", "rust"], "task": "rust_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "rust", "oracle": null, "runnable": false, "tags": ["autocodebench", "rust"], "task": "rust_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "rust", "oracle": null, "runnable": false, "tags": ["autocodebench", "rust"], "task": "rust_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "rust", "oracle": null, "runnable": false, "tags": ["autocodebench", "rust"], "task": "rust_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "scala", "oracle": null, "runnable": false, "tags": ["autocodebench", "scala"], "task": "scala_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "scala", "oracle": null, "runnable": false, "tags": ["autocodebench", "scala"], "task": "scala_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "scala", "oracle": null, "runnable": false, "tags": ["autocodebench", "scala"], "task": "scala_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "scala", "oracle": null, "runnable": false, "tags": ["autocodebench", "scala"], "task": "scala_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "scala", "oracle": null, "runnable": false, "tags": ["autocodebench", "scala"], "task": "scala_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "scala", "oracle": null, "runnable": false, "tags": ["autocodebench", "scala"], "task": "scala_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "scala", "oracle": null, "runnable": false, "tags": ["autocodebench", "scala"], "task": "scala_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "scala", "oracle": null, "runnable": false, "tags": ["autocodebench", "scala"], "task": "scala_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "scala", "oracle": null, "runnable": false, "tags": ["autocodebench", "scala"], "task": "scala_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "scala", "oracle": null, "runnable": false, "tags": ["autocodebench", "scala"], "task": "scala_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "shell", "oracle": null, "runnable": false, "tags": ["autocodebench", "shell"], "task": "shell_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "shell", "oracle": null, "runnable": false, "tags": ["autocodebench", "shell"], "task": "shell_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "shell", "oracle": null, "runnable": false, "tags": ["autocodebench", "shell"], "task": "shell_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "shell", "oracle": null, "runnable": false, "tags": ["autocodebench", "shell"], "task": "shell_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "shell", "oracle": null, "runnable": false, "tags": ["autocodebench", "shell"], "task": "shell_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "shell", "oracle": null, "runnable": false, "tags": ["autocodebench", "shell"], "task": "shell_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "shell", "oracle": null, "runnable": false, "tags": ["autocodebench", "shell"], "task": "shell_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "shell", "oracle": null, "runnable": false, "tags": ["autocodebench", "shell"], "task": "shell_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "shell", "oracle": null, "runnable": false, "tags": ["autocodebench", "shell"], "task": "shell_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "shell", "oracle": null, "runnable": false, "tags": ["autocodebench", "shell"], "task": "shell_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "swift", "oracle": null, "runnable": false, "tags": ["autocodebench", "swift"], "task": "swift_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "easy", "language": "swift", "oracle": null, "runnable": false, "tags": ["autocodebench", "swift"], "task": "swift_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "swift", "oracle": null, "runnable": false, "tags": ["autocodebench", "swift"], "task": "swift_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "swift", "oracle": null, "runnable": false, "tags": ["autocodebench", "swift"], "task": "swift_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "swift", "oracle": null, "runnable": false, "tags": ["autocodebench", "swift"], "task": "swift_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "swift", "oracle": null, "runnable": false, "tags": ["autocodebench", "swift"], "task": "swift_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "swift", "oracle": null, "runnable": false, "tags": ["autocodebench", "swift"], "task": "swift_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "swift", "oracle": null, "runnable": false, "tags": ["autocodebench", "swift"], "task": "swift_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "swift", "oracle": null, "runnable": false, "tags": ["autocodebench", "swift"], "task": "swift_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "swift", "oracle": null, "runnable": false, "tags": ["autocodebench", "swift"], "task": "swift_010", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "typescript", "oracle": null, "runnable": false, "tags": ["autocodebench", "typescript"], "task": "typescript_001", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "typescript", "oracle": null, "runnable": false, "tags": ["autocodebench", "typescript"], "task": "typescript_002", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "typescript", "oracle": null, "runnable": false, "tags": ["autocodebench", "typescript"], "task": "typescript_003", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "typescript", "oracle": null, "runnable": false, "tags": ["autocodebench", "typescript"], "task": "typescript_004", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "typescript", "oracle": null, "runnable": false, "tags": ["autocodebench", "typescript"], "task": "typescript_005", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "typescript", "oracle": null, "runnable": false, "tags": ["autocodebench", "typescript"], "task": "typescript_006", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "typescript", "oracle": null, "runnable": false, "tags": ["autocodebench", "typescript"], "task": "typescript_007", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "typescript", "oracle": null, "runnable": false, "tags": ["autocodebench", "typescript"], "task": "typescript_008", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "medium", "language": "typescript", "oracle": null, "runnable": false, "tags": ["autocodebench", "typescript"], "task": "typescript_009", "taskset": "autocodebench"}, {"agent_timeout": 600, "category": "coding", "compose": false, "difficulty": "hard", "language": "typescript", "oracle": null, "runnable": false, "tags": ["autocodebench", "typescript"], "task": "typescript_010", "taskset": "autocodebench"}], "next": null}