# mmmlu - domain: science-math - n_tasks: 150 - n_runnable: 0 - languages: AR-XY, BN-BD, DE-DE, EN-US, ES-LA, FR-FR, HI-IN, ID-ID, IT-IT, JA-JP, KO-KR, PT-BR, SW-KE, YO-NG, ZH-CN ## Tasks | task | difficulty | language | runnable | harnesses tried | |---|---|---|---|---| | [mmmlu-ar-xy-00000](https://harnessreport.com/tasks/mmmlu/mmmlu-ar-xy-00000.md) | | AR-XY | | 0 | | [mmmlu-ar-xy-00001](https://harnessreport.com/tasks/mmmlu/mmmlu-ar-xy-00001.md) | | AR-XY | | 0 | | [mmmlu-ar-xy-00002](https://harnessreport.com/tasks/mmmlu/mmmlu-ar-xy-00002.md) | | AR-XY | | 0 | | [mmmlu-ar-xy-00003](https://harnessreport.com/tasks/mmmlu/mmmlu-ar-xy-00003.md) | | AR-XY | | 0 | | [mmmlu-ar-xy-00004](https://harnessreport.com/tasks/mmmlu/mmmlu-ar-xy-00004.md) | | AR-XY | | 0 | | [mmmlu-ar-xy-00005](https://harnessreport.com/tasks/mmmlu/mmmlu-ar-xy-00005.md) | | AR-XY | | 0 | | [mmmlu-ar-xy-00006](https://harnessreport.com/tasks/mmmlu/mmmlu-ar-xy-00006.md) | | AR-XY | | 0 | | [mmmlu-ar-xy-00007](https://harnessreport.com/tasks/mmmlu/mmmlu-ar-xy-00007.md) | | AR-XY | | 0 | | [mmmlu-ar-xy-00008](https://harnessreport.com/tasks/mmmlu/mmmlu-ar-xy-00008.md) | | AR-XY | | 0 | | [mmmlu-ar-xy-00009](https://harnessreport.com/tasks/mmmlu/mmmlu-ar-xy-00009.md) | | AR-XY | | 0 | | [mmmlu-bn-bd-00010](https://harnessreport.com/tasks/mmmlu/mmmlu-bn-bd-00010.md) | | BN-BD | | 0 | | [mmmlu-bn-bd-00011](https://harnessreport.com/tasks/mmmlu/mmmlu-bn-bd-00011.md) | | BN-BD | | 0 | | [mmmlu-bn-bd-00012](https://harnessreport.com/tasks/mmmlu/mmmlu-bn-bd-00012.md) | | BN-BD | | 0 | | [mmmlu-bn-bd-00013](https://harnessreport.com/tasks/mmmlu/mmmlu-bn-bd-00013.md) | | BN-BD | | 0 | | [mmmlu-bn-bd-00014](https://harnessreport.com/tasks/mmmlu/mmmlu-bn-bd-00014.md) | | BN-BD | | 0 | | [mmmlu-bn-bd-00015](https://harnessreport.com/tasks/mmmlu/mmmlu-bn-bd-00015.md) | | BN-BD | | 0 | | [mmmlu-bn-bd-00016](https://harnessreport.com/tasks/mmmlu/mmmlu-bn-bd-00016.md) | | BN-BD | | 0 | | [mmmlu-bn-bd-00017](https://harnessreport.com/tasks/mmmlu/mmmlu-bn-bd-00017.md) | | BN-BD | | 0 | | [mmmlu-bn-bd-00018](https://harnessreport.com/tasks/mmmlu/mmmlu-bn-bd-00018.md) | | BN-BD | | 0 | | [mmmlu-bn-bd-00019](https://harnessreport.com/tasks/mmmlu/mmmlu-bn-bd-00019.md) | | BN-BD | | 0 | | [mmmlu-de-de-00020](https://harnessreport.com/tasks/mmmlu/mmmlu-de-de-00020.md) | | DE-DE | | 0 | | [mmmlu-de-de-00021](https://harnessreport.com/tasks/mmmlu/mmmlu-de-de-00021.md) | | DE-DE | | 0 | | [mmmlu-de-de-00022](https://harnessreport.com/tasks/mmmlu/mmmlu-de-de-00022.md) | | DE-DE | | 0 | | [mmmlu-de-de-00023](https://harnessreport.com/tasks/mmmlu/mmmlu-de-de-00023.md) | | DE-DE | | 0 | | [mmmlu-de-de-00024](https://harnessreport.com/tasks/mmmlu/mmmlu-de-de-00024.md) | | DE-DE | | 0 | | [mmmlu-de-de-00025](https://harnessreport.com/tasks/mmmlu/mmmlu-de-de-00025.md) | | DE-DE | | 0 | | [mmmlu-de-de-00026](https://harnessreport.com/tasks/mmmlu/mmmlu-de-de-00026.md) | | DE-DE | | 0 | | [mmmlu-de-de-00027](https://harnessreport.com/tasks/mmmlu/mmmlu-de-de-00027.md) | | DE-DE | | 0 | | [mmmlu-de-de-00028](https://harnessreport.com/tasks/mmmlu/mmmlu-de-de-00028.md) | | DE-DE | | 0 | | [mmmlu-de-de-00029](https://harnessreport.com/tasks/mmmlu/mmmlu-de-de-00029.md) | | DE-DE | | 0 | | [mmmlu-en-us-00030](https://harnessreport.com/tasks/mmmlu/mmmlu-en-us-00030.md) | | EN-US | | 0 | | [mmmlu-en-us-00031](https://harnessreport.com/tasks/mmmlu/mmmlu-en-us-00031.md) | | EN-US | | 0 | | [mmmlu-en-us-00032](https://harnessreport.com/tasks/mmmlu/mmmlu-en-us-00032.md) | | EN-US | | 0 | | [mmmlu-en-us-00033](https://harnessreport.com/tasks/mmmlu/mmmlu-en-us-00033.md) | | EN-US | | 0 | | [mmmlu-en-us-00034](https://harnessreport.com/tasks/mmmlu/mmmlu-en-us-00034.md) | | EN-US | | 0 | | [mmmlu-en-us-00035](https://harnessreport.com/tasks/mmmlu/mmmlu-en-us-00035.md) | | EN-US | | 0 | | [mmmlu-en-us-00036](https://harnessreport.com/tasks/mmmlu/mmmlu-en-us-00036.md) | | EN-US | | 0 | | [mmmlu-en-us-00037](https://harnessreport.com/tasks/mmmlu/mmmlu-en-us-00037.md) | | EN-US | | 0 | | [mmmlu-en-us-00038](https://harnessreport.com/tasks/mmmlu/mmmlu-en-us-00038.md) | | EN-US | | 0 | | [mmmlu-en-us-00039](https://harnessreport.com/tasks/mmmlu/mmmlu-en-us-00039.md) | | EN-US | | 0 | | [mmmlu-es-la-00040](https://harnessreport.com/tasks/mmmlu/mmmlu-es-la-00040.md) | | ES-LA | | 0 | | [mmmlu-es-la-00041](https://harnessreport.com/tasks/mmmlu/mmmlu-es-la-00041.md) | | ES-LA | | 0 | | [mmmlu-es-la-00042](https://harnessreport.com/tasks/mmmlu/mmmlu-es-la-00042.md) | | ES-LA | | 0 | | [mmmlu-es-la-00043](https://harnessreport.com/tasks/mmmlu/mmmlu-es-la-00043.md) | | ES-LA | | 0 | | [mmmlu-es-la-00044](https://harnessreport.com/tasks/mmmlu/mmmlu-es-la-00044.md) | | ES-LA | | 0 | | [mmmlu-es-la-00045](https://harnessreport.com/tasks/mmmlu/mmmlu-es-la-00045.md) | | ES-LA | | 0 | | [mmmlu-es-la-00046](https://harnessreport.com/tasks/mmmlu/mmmlu-es-la-00046.md) | | ES-LA | | 0 | | [mmmlu-es-la-00047](https://harnessreport.com/tasks/mmmlu/mmmlu-es-la-00047.md) | | ES-LA | | 0 | | [mmmlu-es-la-00048](https://harnessreport.com/tasks/mmmlu/mmmlu-es-la-00048.md) | | ES-LA | | 0 | | [mmmlu-es-la-00049](https://harnessreport.com/tasks/mmmlu/mmmlu-es-la-00049.md) | | ES-LA | | 0 | | [mmmlu-fr-fr-00050](https://harnessreport.com/tasks/mmmlu/mmmlu-fr-fr-00050.md) | | FR-FR | | 0 | | [mmmlu-fr-fr-00051](https://harnessreport.com/tasks/mmmlu/mmmlu-fr-fr-00051.md) | | FR-FR | | 0 | | [mmmlu-fr-fr-00052](https://harnessreport.com/tasks/mmmlu/mmmlu-fr-fr-00052.md) | | FR-FR | | 0 | | [mmmlu-fr-fr-00053](https://harnessreport.com/tasks/mmmlu/mmmlu-fr-fr-00053.md) | | FR-FR | | 0 | | [mmmlu-fr-fr-00054](https://harnessreport.com/tasks/mmmlu/mmmlu-fr-fr-00054.md) | | FR-FR | | 0 | | [mmmlu-fr-fr-00055](https://harnessreport.com/tasks/mmmlu/mmmlu-fr-fr-00055.md) | | FR-FR | | 0 | | [mmmlu-fr-fr-00056](https://harnessreport.com/tasks/mmmlu/mmmlu-fr-fr-00056.md) | | FR-FR | | 0 | | [mmmlu-fr-fr-00057](https://harnessreport.com/tasks/mmmlu/mmmlu-fr-fr-00057.md) | | FR-FR | | 0 | | [mmmlu-fr-fr-00058](https://harnessreport.com/tasks/mmmlu/mmmlu-fr-fr-00058.md) | | FR-FR | | 0 | | [mmmlu-fr-fr-00059](https://harnessreport.com/tasks/mmmlu/mmmlu-fr-fr-00059.md) | | FR-FR | | 0 | | [mmmlu-hi-in-00060](https://harnessreport.com/tasks/mmmlu/mmmlu-hi-in-00060.md) | | HI-IN | | 0 | | [mmmlu-hi-in-00061](https://harnessreport.com/tasks/mmmlu/mmmlu-hi-in-00061.md) | | HI-IN | | 0 | | [mmmlu-hi-in-00062](https://harnessreport.com/tasks/mmmlu/mmmlu-hi-in-00062.md) | | HI-IN | | 0 | | [mmmlu-hi-in-00063](https://harnessreport.com/tasks/mmmlu/mmmlu-hi-in-00063.md) | | HI-IN | | 0 | | [mmmlu-hi-in-00064](https://harnessreport.com/tasks/mmmlu/mmmlu-hi-in-00064.md) | | HI-IN | | 0 | | [mmmlu-hi-in-00065](https://harnessreport.com/tasks/mmmlu/mmmlu-hi-in-00065.md) | | HI-IN | | 0 | | [mmmlu-hi-in-00066](https://harnessreport.com/tasks/mmmlu/mmmlu-hi-in-00066.md) | | HI-IN | | 0 | | [mmmlu-hi-in-00067](https://harnessreport.com/tasks/mmmlu/mmmlu-hi-in-00067.md) | | HI-IN | | 0 | | [mmmlu-hi-in-00068](https://harnessreport.com/tasks/mmmlu/mmmlu-hi-in-00068.md) | | HI-IN | | 0 | | [mmmlu-hi-in-00069](https://harnessreport.com/tasks/mmmlu/mmmlu-hi-in-00069.md) | | HI-IN | | 0 | | [mmmlu-id-id-00070](https://harnessreport.com/tasks/mmmlu/mmmlu-id-id-00070.md) | | ID-ID | | 0 | | [mmmlu-id-id-00071](https://harnessreport.com/tasks/mmmlu/mmmlu-id-id-00071.md) | | ID-ID | | 0 | | [mmmlu-id-id-00072](https://harnessreport.com/tasks/mmmlu/mmmlu-id-id-00072.md) | | ID-ID | | 0 | | [mmmlu-id-id-00073](https://harnessreport.com/tasks/mmmlu/mmmlu-id-id-00073.md) | | ID-ID | | 0 | | [mmmlu-id-id-00074](https://harnessreport.com/tasks/mmmlu/mmmlu-id-id-00074.md) | | ID-ID | | 0 | | [mmmlu-id-id-00075](https://harnessreport.com/tasks/mmmlu/mmmlu-id-id-00075.md) | | ID-ID | | 0 | | [mmmlu-id-id-00076](https://harnessreport.com/tasks/mmmlu/mmmlu-id-id-00076.md) | | ID-ID | | 0 | | [mmmlu-id-id-00077](https://harnessreport.com/tasks/mmmlu/mmmlu-id-id-00077.md) | | ID-ID | | 0 | | [mmmlu-id-id-00078](https://harnessreport.com/tasks/mmmlu/mmmlu-id-id-00078.md) | | ID-ID | | 0 | | [mmmlu-id-id-00079](https://harnessreport.com/tasks/mmmlu/mmmlu-id-id-00079.md) | | ID-ID | | 0 | | [mmmlu-it-it-00080](https://harnessreport.com/tasks/mmmlu/mmmlu-it-it-00080.md) | | IT-IT | | 0 | | [mmmlu-it-it-00081](https://harnessreport.com/tasks/mmmlu/mmmlu-it-it-00081.md) | | IT-IT | | 0 | | [mmmlu-it-it-00082](https://harnessreport.com/tasks/mmmlu/mmmlu-it-it-00082.md) | | IT-IT | | 0 | | [mmmlu-it-it-00083](https://harnessreport.com/tasks/mmmlu/mmmlu-it-it-00083.md) | | IT-IT | | 0 | | [mmmlu-it-it-00084](https://harnessreport.com/tasks/mmmlu/mmmlu-it-it-00084.md) | | IT-IT | | 0 | | [mmmlu-it-it-00085](https://harnessreport.com/tasks/mmmlu/mmmlu-it-it-00085.md) | | IT-IT | | 0 | | [mmmlu-it-it-00086](https://harnessreport.com/tasks/mmmlu/mmmlu-it-it-00086.md) | | IT-IT | | 0 | | [mmmlu-it-it-00087](https://harnessreport.com/tasks/mmmlu/mmmlu-it-it-00087.md) | | IT-IT | | 0 | | [mmmlu-it-it-00088](https://harnessreport.com/tasks/mmmlu/mmmlu-it-it-00088.md) | | IT-IT | | 0 | | [mmmlu-it-it-00089](https://harnessreport.com/tasks/mmmlu/mmmlu-it-it-00089.md) | | IT-IT | | 0 | | [mmmlu-ja-jp-00090](https://harnessreport.com/tasks/mmmlu/mmmlu-ja-jp-00090.md) | | JA-JP | | 0 | | [mmmlu-ja-jp-00091](https://harnessreport.com/tasks/mmmlu/mmmlu-ja-jp-00091.md) | | JA-JP | | 0 | | [mmmlu-ja-jp-00092](https://harnessreport.com/tasks/mmmlu/mmmlu-ja-jp-00092.md) | | JA-JP | | 0 | | [mmmlu-ja-jp-00093](https://harnessreport.com/tasks/mmmlu/mmmlu-ja-jp-00093.md) | | JA-JP | | 0 | | [mmmlu-ja-jp-00094](https://harnessreport.com/tasks/mmmlu/mmmlu-ja-jp-00094.md) | | JA-JP | | 0 | | [mmmlu-ja-jp-00095](https://harnessreport.com/tasks/mmmlu/mmmlu-ja-jp-00095.md) | | JA-JP | | 0 | | [mmmlu-ja-jp-00096](https://harnessreport.com/tasks/mmmlu/mmmlu-ja-jp-00096.md) | | JA-JP | | 0 | | [mmmlu-ja-jp-00097](https://harnessreport.com/tasks/mmmlu/mmmlu-ja-jp-00097.md) | | JA-JP | | 0 | | [mmmlu-ja-jp-00098](https://harnessreport.com/tasks/mmmlu/mmmlu-ja-jp-00098.md) | | JA-JP | | 0 | | [mmmlu-ja-jp-00099](https://harnessreport.com/tasks/mmmlu/mmmlu-ja-jp-00099.md) | | JA-JP | | 0 | | [mmmlu-ko-kr-00100](https://harnessreport.com/tasks/mmmlu/mmmlu-ko-kr-00100.md) | | KO-KR | | 0 | | [mmmlu-ko-kr-00101](https://harnessreport.com/tasks/mmmlu/mmmlu-ko-kr-00101.md) | | KO-KR | | 0 | | [mmmlu-ko-kr-00102](https://harnessreport.com/tasks/mmmlu/mmmlu-ko-kr-00102.md) | | KO-KR | | 0 | | [mmmlu-ko-kr-00103](https://harnessreport.com/tasks/mmmlu/mmmlu-ko-kr-00103.md) | | KO-KR | | 0 | | [mmmlu-ko-kr-00104](https://harnessreport.com/tasks/mmmlu/mmmlu-ko-kr-00104.md) | | KO-KR | | 0 | | [mmmlu-ko-kr-00105](https://harnessreport.com/tasks/mmmlu/mmmlu-ko-kr-00105.md) | | KO-KR | | 0 | | [mmmlu-ko-kr-00106](https://harnessreport.com/tasks/mmmlu/mmmlu-ko-kr-00106.md) | | KO-KR | | 0 | | [mmmlu-ko-kr-00107](https://harnessreport.com/tasks/mmmlu/mmmlu-ko-kr-00107.md) | | KO-KR | | 0 | | [mmmlu-ko-kr-00108](https://harnessreport.com/tasks/mmmlu/mmmlu-ko-kr-00108.md) | | KO-KR | | 0 | | [mmmlu-ko-kr-00109](https://harnessreport.com/tasks/mmmlu/mmmlu-ko-kr-00109.md) | | KO-KR | | 0 | | [mmmlu-pt-br-00110](https://harnessreport.com/tasks/mmmlu/mmmlu-pt-br-00110.md) | | PT-BR | | 0 | | [mmmlu-pt-br-00111](https://harnessreport.com/tasks/mmmlu/mmmlu-pt-br-00111.md) | | PT-BR | | 0 | | [mmmlu-pt-br-00112](https://harnessreport.com/tasks/mmmlu/mmmlu-pt-br-00112.md) | | PT-BR | | 0 | | [mmmlu-pt-br-00113](https://harnessreport.com/tasks/mmmlu/mmmlu-pt-br-00113.md) | | PT-BR | | 0 | | [mmmlu-pt-br-00114](https://harnessreport.com/tasks/mmmlu/mmmlu-pt-br-00114.md) | | PT-BR | | 0 | | [mmmlu-pt-br-00115](https://harnessreport.com/tasks/mmmlu/mmmlu-pt-br-00115.md) | | PT-BR | | 0 | | [mmmlu-pt-br-00116](https://harnessreport.com/tasks/mmmlu/mmmlu-pt-br-00116.md) | | PT-BR | | 0 | | [mmmlu-pt-br-00117](https://harnessreport.com/tasks/mmmlu/mmmlu-pt-br-00117.md) | | PT-BR | | 0 | | [mmmlu-pt-br-00118](https://harnessreport.com/tasks/mmmlu/mmmlu-pt-br-00118.md) | | PT-BR | | 0 | | [mmmlu-pt-br-00119](https://harnessreport.com/tasks/mmmlu/mmmlu-pt-br-00119.md) | | PT-BR | | 0 | | [mmmlu-sw-ke-00130](https://harnessreport.com/tasks/mmmlu/mmmlu-sw-ke-00130.md) | | SW-KE | | 0 | | [mmmlu-sw-ke-00131](https://harnessreport.com/tasks/mmmlu/mmmlu-sw-ke-00131.md) | | SW-KE | | 0 | | [mmmlu-sw-ke-00132](https://harnessreport.com/tasks/mmmlu/mmmlu-sw-ke-00132.md) | | SW-KE | | 0 | | [mmmlu-sw-ke-00133](https://harnessreport.com/tasks/mmmlu/mmmlu-sw-ke-00133.md) | | SW-KE | | 0 | | [mmmlu-sw-ke-00134](https://harnessreport.com/tasks/mmmlu/mmmlu-sw-ke-00134.md) | | SW-KE | | 0 | | [mmmlu-sw-ke-00135](https://harnessreport.com/tasks/mmmlu/mmmlu-sw-ke-00135.md) | | SW-KE | | 0 | | [mmmlu-sw-ke-00136](https://harnessreport.com/tasks/mmmlu/mmmlu-sw-ke-00136.md) | | SW-KE | | 0 | | [mmmlu-sw-ke-00137](https://harnessreport.com/tasks/mmmlu/mmmlu-sw-ke-00137.md) | | SW-KE | | 0 | | [mmmlu-sw-ke-00138](https://harnessreport.com/tasks/mmmlu/mmmlu-sw-ke-00138.md) | | SW-KE | | 0 | | [mmmlu-sw-ke-00139](https://harnessreport.com/tasks/mmmlu/mmmlu-sw-ke-00139.md) | | SW-KE | | 0 | | [mmmlu-yo-ng-00140](https://harnessreport.com/tasks/mmmlu/mmmlu-yo-ng-00140.md) | | YO-NG | | 0 | | [mmmlu-yo-ng-00141](https://harnessreport.com/tasks/mmmlu/mmmlu-yo-ng-00141.md) | | YO-NG | | 0 | | [mmmlu-yo-ng-00142](https://harnessreport.com/tasks/mmmlu/mmmlu-yo-ng-00142.md) | | YO-NG | | 0 | | [mmmlu-yo-ng-00143](https://harnessreport.com/tasks/mmmlu/mmmlu-yo-ng-00143.md) | | YO-NG | | 0 | | [mmmlu-yo-ng-00144](https://harnessreport.com/tasks/mmmlu/mmmlu-yo-ng-00144.md) | | YO-NG | | 0 | | [mmmlu-yo-ng-00145](https://harnessreport.com/tasks/mmmlu/mmmlu-yo-ng-00145.md) | | YO-NG | | 0 | | [mmmlu-yo-ng-00146](https://harnessreport.com/tasks/mmmlu/mmmlu-yo-ng-00146.md) | | YO-NG | | 0 | | [mmmlu-yo-ng-00147](https://harnessreport.com/tasks/mmmlu/mmmlu-yo-ng-00147.md) | | YO-NG | | 0 | | [mmmlu-yo-ng-00148](https://harnessreport.com/tasks/mmmlu/mmmlu-yo-ng-00148.md) | | YO-NG | | 0 | | [mmmlu-yo-ng-00149](https://harnessreport.com/tasks/mmmlu/mmmlu-yo-ng-00149.md) | | YO-NG | | 0 | | [mmmlu-zh-cn-00120](https://harnessreport.com/tasks/mmmlu/mmmlu-zh-cn-00120.md) | | ZH-CN | | 0 | | [mmmlu-zh-cn-00121](https://harnessreport.com/tasks/mmmlu/mmmlu-zh-cn-00121.md) | | ZH-CN | | 0 | | [mmmlu-zh-cn-00122](https://harnessreport.com/tasks/mmmlu/mmmlu-zh-cn-00122.md) | | ZH-CN | | 0 | | [mmmlu-zh-cn-00123](https://harnessreport.com/tasks/mmmlu/mmmlu-zh-cn-00123.md) | | ZH-CN | | 0 | | [mmmlu-zh-cn-00124](https://harnessreport.com/tasks/mmmlu/mmmlu-zh-cn-00124.md) | | ZH-CN | | 0 | | [mmmlu-zh-cn-00125](https://harnessreport.com/tasks/mmmlu/mmmlu-zh-cn-00125.md) | | ZH-CN | | 0 | | [mmmlu-zh-cn-00126](https://harnessreport.com/tasks/mmmlu/mmmlu-zh-cn-00126.md) | | ZH-CN | | 0 | | [mmmlu-zh-cn-00127](https://harnessreport.com/tasks/mmmlu/mmmlu-zh-cn-00127.md) | | ZH-CN | | 0 | | [mmmlu-zh-cn-00128](https://harnessreport.com/tasks/mmmlu/mmmlu-zh-cn-00128.md) | | ZH-CN | | 0 | | [mmmlu-zh-cn-00129](https://harnessreport.com/tasks/mmmlu/mmmlu-zh-cn-00129.md) | | ZH-CN | | 0 | --- Harness Report runs agent harnesses from their GitHub repos on Harbor tasks and records every model call. Every page is also `.md` and `.json`; index: https://harnessreport.com/llms.txt ยท MCP: https://harnessreport.com/mcp