{"taskset": {"n_runnable": 0, "name": "ScienceAgentBench", "url_data": "https://huggingface.co/datasets/osunlp/ScienceAgentBench", "catalog_id": "scienceagentbench", "owner_type": "academic", "cited_by": [], "taskset": "scienceagentbench", "domain": "science-math", "task_kind": "data-driven scientific discovery programs", "environment": "container", "grading": "tests", "path": "hub-datasets/scienceagentbench", "n_single_container": 102, "n_tasks": 102, "domain_raw": "science", "sample_instruction": "You are tasked with a scientific computing problem. Write a self-contained Python program to solve it.\n\n## Task\n\nTrain a multitask model on the Clintox dataset to predict a drug's toxicity and FDA approval status. Save the test set predictions, including the SMILES representation of drugs and the probability of positive labels, to \"pred_results/clintox_test_pred.csv\".\n\n## Domain Knowledge\n\n1. *On the task*: The ClinTox dataset contains drugs approved by the US Food and Drug Administration (FDA) and drugs that have failed clinical trials for toxicity reasons. The dataset includes two binary classification tasks for 1491 drug compounds with known chemical structures: (1) clinical trial toxicity (or absence of toxicity) and (2) FDA approval status. This requires developing a model with two binary classification heads each determining the label of its respective task based on the molecular structure. Use `MultitaskClassifier` model from the deepchem library.\n2. *On featurization*: To represent the molecular structure, use Extended-Connectivity Fingerprints (ECFPs) featurization in deepchem. ECFPs are circular topological fingerprints that represent the presence of particular substructures and stereochemical information.\n\n## Input Data\n\nThe input dataset is located at `benchmark/datasets/clintox/` (relative to the working directory `/testbed/`).\n\n**Directory structure:**\n```\n|-- clintox/\n|---- clintox_test.csv\n|---- clintox_train.csv\n```\n\n**Data preview:**\n```\n[START Preview of cl", "owner_org": "OSU NLP", "url_repo": "https://github.com/OSU-NLP-Group/ScienceAgentBench", "url_paper": "https://arxiv.org/abs/2410.05080", "license": "cc-by-4.0", "languages": [], "difficulties": {"hard": 23, "medium": 79}, "categories": ["scientific_computing"]}, "tasks": [{"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_1", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_10", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_100", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_101", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_102", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_11", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_12", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_13", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_14", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_15", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_16", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_17", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_18", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_19", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_2", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_20", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_21", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_22", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_23", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_24", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_25", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_26", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_27", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_28", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_29", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_3", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_30", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_31", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_32", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_33", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_34", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_35", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_36", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_37", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_38", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_39", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_4", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_40", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_41", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_42", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_43", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_44", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_45", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_46", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_47", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_48", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_49", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_5", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_50", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_51", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_52", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_53", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_54", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_55", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_56", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_57", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_58", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_59", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_6", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_60", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_61", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_62", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_63", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_64", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_65", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_66", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_67", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_68", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_69", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_7", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_70", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_71", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_72", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_73", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_74", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_75", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_76", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_77", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_78", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_79", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_8", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_80", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_81", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_82", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_83", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_84", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_85", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_86", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_87", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_88", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Geographical Information Science", "scientific_computing"], "task": "sab_89", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_9", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_90", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_91", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_92", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Psychology and Cognitive science", "scientific_computing"], "task": "sab_93", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_94", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_95", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_96", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "hard", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Computational Chemistry", "scientific_computing"], "task": "sab_97", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_98", "taskset": "scienceagentbench"}, {"agent_timeout": 3600, "category": "scientific_computing", "compose": false, "difficulty": "medium", "language": "", "oracle": null, "runnable": false, "tags": ["scienceagentbench", "Bioinformatics", "scientific_computing"], "task": "sab_99", "taskset": "scienceagentbench"}], "next": null}