hellaswag_step02500: by examples

Results Paper Code


Not solved by any model

There are 5058 examples not solved by any model. Solving some of these can be a good signal that your model is indeed better than leading models if these are good problems.
hellaswag/1, hellaswag/100, hellaswag/10001, hellaswag/10002, hellaswag/10003, hellaswag/10004, hellaswag/10009, hellaswag/10010, hellaswag/10011, hellaswag/10014, hellaswag/10016, hellaswag/10018, hellaswag/10019, hellaswag/10020, hellaswag/10022, hellaswag/10024, hellaswag/10025, hellaswag/10026, hellaswag/10027, hellaswag/10029, hellaswag/10030, hellaswag/10032, hellaswag/10033, hellaswag/10036, hellaswag/10037, hellaswag/10038, hellaswag/10039, hellaswag/1004, hellaswag/1005, hellaswag/1006, hellaswag/1008, hellaswag/101, hellaswag/1010, hellaswag/1012, hellaswag/1015, hellaswag/1016, hellaswag/102, hellaswag/1020, hellaswag/1021, hellaswag/1022, hellaswag/1026, hellaswag/1029, hellaswag/103, hellaswag/1036, hellaswag/1037, hellaswag/1038, hellaswag/104, hellaswag/1042, hellaswag/1046, hellaswag/1047, hellaswag/105, hellaswag/1050, hellaswag/1051, hellaswag/1054, hellaswag/1055, hellaswag/1057, hellaswag/1059, hellaswag/1063, hellaswag/1065, hellaswag/1067, hellaswag/1069, hellaswag/1071, hellaswag/1073, hellaswag/1074, hellaswag/1075, hellaswag/1078, hellaswag/1080, hellaswag/1082, hellaswag/1085, hellaswag/1087, hellaswag/1088, hellaswag/1089, hellaswag/109, hellaswag/1092, hellaswag/1093, hellaswag/1096, hellaswag/1099, hellaswag/11, hellaswag/110, hellaswag/1100, hellaswag/1108, hellaswag/1109, hellaswag/1112, hellaswag/1115, hellaswag/1116, hellaswag/1121, hellaswag/1122, hellaswag/1123, hellaswag/1124, hellaswag/1125, hellaswag/1139, hellaswag/1140, hellaswag/1145, hellaswag/1147, hellaswag/115, hellaswag/1151, hellaswag/116, hellaswag/1160, hellaswag/1161, hellaswag/1163, hellaswag/1164, hellaswag/1165, hellaswag/1167, hellaswag/1168, hellaswag/1171, hellaswag/1173, hellaswag/1176, hellaswag/1177, hellaswag/1178, hellaswag/118, hellaswag/1181, hellaswag/1184, hellaswag/1185, hellaswag/1193, hellaswag/12, hellaswag/1200, hellaswag/1202, hellaswag/1205, hellaswag/121, hellaswag/1210, hellaswag/1211, hellaswag/1212, hellaswag/1213, hellaswag/1215, hellaswag/1216, hellaswag/1217, hellaswag/1218, hellaswag/1224, hellaswag/1225, hellaswag/1227, hellaswag/1228, hellaswag/123, hellaswag/1231, hellaswag/1235, hellaswag/1237, hellaswag/1238, hellaswag/1239, hellaswag/124, hellaswag/1244, hellaswag/1245, hellaswag/1247, hellaswag/1249, hellaswag/125, hellaswag/1252, hellaswag/1254, hellaswag/1259, hellaswag/1261, hellaswag/1265, hellaswag/1266, hellaswag/1269, hellaswag/127, hellaswag/1270, hellaswag/1271, hellaswag/1273, hellaswag/1275, hellaswag/1277, hellaswag/1280, hellaswag/1282, hellaswag/1283, hellaswag/1284, hellaswag/1285, hellaswag/1287, hellaswag/1289, hellaswag/1291, hellaswag/1293, hellaswag/1294, hellaswag/1295, hellaswag/1297, hellaswag/130, hellaswag/1301, hellaswag/1302, hellaswag/1304, hellaswag/1308, hellaswag/1309, hellaswag/1310, hellaswag/1311, hellaswag/1313, hellaswag/1315, hellaswag/1321, hellaswag/1322, hellaswag/1324, hellaswag/1333, hellaswag/1336, hellaswag/1337, hellaswag/1342, hellaswag/1345, hellaswag/1354, hellaswag/1356, hellaswag/1358, hellaswag/1359, hellaswag/1361, hellaswag/1362, hellaswag/1364, hellaswag/1365, hellaswag/1368, hellaswag/1369, hellaswag/1372, hellaswag/1375, hellaswag/1376, hellaswag/1379, hellaswag/1381, hellaswag/1383, hellaswag/1384, hellaswag/1389, hellaswag/1390, hellaswag/1392, hellaswag/1394, hellaswag/1395, hellaswag/1397, hellaswag/1400, hellaswag/1401, hellaswag/1402, hellaswag/1405, hellaswag/1407, hellaswag/1409, hellaswag/1410, hellaswag/1412, hellaswag/1414, hellaswag/1415, hellaswag/142, hellaswag/1420, hellaswag/1421, hellaswag/1424, hellaswag/1426, hellaswag/1432, hellaswag/1434, hellaswag/1438, hellaswag/1439, hellaswag/1441, hellaswag/1442, hellaswag/1444, hellaswag/1446, hellaswag/1448, hellaswag/1449, hellaswag/145, hellaswag/1450, hellaswag/1451, hellaswag/1452, hellaswag/1456, hellaswag/1458, hellaswag/1460, hellaswag/1465, hellaswag/1467, hellaswag/1468, hellaswag/1469, hellaswag/1470, hellaswag/1472, hellaswag/1473, hellaswag/1474, hellaswag/1476, hellaswag/1477, hellaswag/1478, hellaswag/148, hellaswag/1480, hellaswag/1482, hellaswag/1486, hellaswag/1487, hellaswag/1491, hellaswag/1492, hellaswag/1494, hellaswag/1496, hellaswag/1497, hellaswag/1499, hellaswag/1501, hellaswag/1502, hellaswag/1505, hellaswag/1506, hellaswag/1508, hellaswag/1509, hellaswag/151, hellaswag/1510, hellaswag/1512, hellaswag/1515, hellaswag/1516, hellaswag/152, hellaswag/1525, hellaswag/1528, hellaswag/1529, hellaswag/153, hellaswag/1532, hellaswag/1536, hellaswag/1538, hellaswag/1539, hellaswag/1540, hellaswag/1541, hellaswag/1542, hellaswag/1543, hellaswag/1544, hellaswag/1545, hellaswag/1547, hellaswag/1549, hellaswag/155, hellaswag/1550, hellaswag/1552, hellaswag/1553, hellaswag/1554, hellaswag/1555, hellaswag/1556, hellaswag/1559, hellaswag/1564, hellaswag/1565, hellaswag/1567, hellaswag/1569, hellaswag/1572, hellaswag/1573, hellaswag/1575, hellaswag/1577, hellaswag/1578, hellaswag/1579, hellaswag/1580, hellaswag/1584, hellaswag/1586, hellaswag/1590, hellaswag/1592, hellaswag/16, hellaswag/1603, hellaswag/1604, hellaswag/1607, hellaswag/1608, hellaswag/161, hellaswag/1610, hellaswag/1616, hellaswag/1618, hellaswag/1619, hellaswag/1622, hellaswag/1624, hellaswag/1626, hellaswag/163, hellaswag/1633, hellaswag/1640, hellaswag/1641, hellaswag/1642, hellaswag/1643, hellaswag/1648, hellaswag/1650, hellaswag/1651, hellaswag/1652, hellaswag/1654, hellaswag/1655, hellaswag/1659, hellaswag/166, hellaswag/1660, hellaswag/1661, hellaswag/1662, hellaswag/1663, hellaswag/1664, hellaswag/1665, hellaswag/1666, hellaswag/1667, hellaswag/1670, hellaswag/1672, hellaswag/1673, hellaswag/1675, hellaswag/1676, hellaswag/1677, hellaswag/1683, hellaswag/1685, hellaswag/1686, hellaswag/1687, hellaswag/1688, hellaswag/1689, hellaswag/169, hellaswag/1693, hellaswag/1697, hellaswag/1698, hellaswag/1699, hellaswag/17, hellaswag/170, hellaswag/1701, hellaswag/1703, hellaswag/1706, hellaswag/1711, hellaswag/1712, hellaswag/1713, hellaswag/1717, hellaswag/172, hellaswag/1720, hellaswag/1721, hellaswag/1722, hellaswag/1726, hellaswag/1728, hellaswag/173, hellaswag/1730, hellaswag/1732, hellaswag/1734, hellaswag/1740, hellaswag/1741, hellaswag/1742, hellaswag/1743, hellaswag/1745, hellaswag/1747, hellaswag/1748, hellaswag/1752, hellaswag/1754, hellaswag/1757, hellaswag/1761, hellaswag/1762, hellaswag/1769, hellaswag/177, hellaswag/1774, hellaswag/1775, hellaswag/1779, hellaswag/1780, hellaswag/1781, hellaswag/1784, hellaswag/1785, hellaswag/1788, hellaswag/1791, hellaswag/1794, hellaswag/1797, hellaswag/1798, hellaswag/180, hellaswag/1800, hellaswag/1805, hellaswag/1806, hellaswag/1807, hellaswag/1812, hellaswag/1814, hellaswag/1815, hellaswag/1819, hellaswag/182, hellaswag/1822, hellaswag/1825, hellaswag/1828, hellaswag/183, hellaswag/1832, hellaswag/1835, hellaswag/1836, hellaswag/1839, hellaswag/1840, hellaswag/1844, hellaswag/1845, hellaswag/1846, hellaswag/1848, hellaswag/1851, hellaswag/1853, hellaswag/1854, hellaswag/1855, hellaswag/1857, hellaswag/186, hellaswag/1862, hellaswag/1864, hellaswag/1865, hellaswag/1866, hellaswag/1867, hellaswag/1869, hellaswag/187, hellaswag/1870, hellaswag/1871, hellaswag/1872, hellaswag/1874, hellaswag/1875, hellaswag/1876, hellaswag/1877, hellaswag/1878, hellaswag/1881, hellaswag/1888, hellaswag/1891, hellaswag/1892, hellaswag/1893, hellaswag/1895, hellaswag/190, hellaswag/1900, hellaswag/1903, hellaswag/1906, hellaswag/1908, hellaswag/191, hellaswag/1912, hellaswag/1916, hellaswag/1917, hellaswag/192, hellaswag/1923, hellaswag/193, hellaswag/1930, hellaswag/1931, hellaswag/1932, hellaswag/1936, hellaswag/1937, hellaswag/1938, hellaswag/1941, hellaswag/1944, hellaswag/1945, hellaswag/1946, hellaswag/1947, hellaswag/1948, hellaswag/1952, hellaswag/1956, hellaswag/1959, hellaswag/196, hellaswag/1960, hellaswag/1961, hellaswag/1963, hellaswag/1966, hellaswag/1967, hellaswag/1970, hellaswag/1971, hellaswag/1974, hellaswag/1976, hellaswag/1978, hellaswag/198, hellaswag/1980, hellaswag/1981, hellaswag/1982, hellaswag/1984, hellaswag/1985, hellaswag/1986, hellaswag/1987, hellaswag/1990, hellaswag/1991, hellaswag/20, hellaswag/2003, hellaswag/2004, hellaswag/2005, hellaswag/2009, hellaswag/201, hellaswag/2011, hellaswag/2012, hellaswag/2014, hellaswag/2015, hellaswag/2017, hellaswag/2022, hellaswag/2023, hellaswag/2025, hellaswag/2027, hellaswag/2035, hellaswag/2037, hellaswag/2039, hellaswag/204, hellaswag/2043, hellaswag/2044, hellaswag/2045, hellaswag/2046, hellaswag/2047, hellaswag/205, hellaswag/2052, hellaswag/2055, hellaswag/2056, hellaswag/2058, hellaswag/2059, hellaswag/2062, hellaswag/2066, hellaswag/2067, hellaswag/2071, hellaswag/2072, hellaswag/2074, hellaswag/2075, hellaswag/2076, hellaswag/2078, hellaswag/2082, hellaswag/2083, hellaswag/2086, hellaswag/2087, hellaswag/2088, hellaswag/2093, hellaswag/2095, hellaswag/2099, hellaswag/21, hellaswag/210, hellaswag/2100, hellaswag/2101, hellaswag/2104, hellaswag/2105, hellaswag/2106, hellaswag/2107, hellaswag/2108, hellaswag/2112, hellaswag/2118, hellaswag/212, hellaswag/2121, hellaswag/2126, hellaswag/2127, hellaswag/2128, hellaswag/2129, hellaswag/2134, hellaswag/2135, hellaswag/2136, hellaswag/2137, hellaswag/2138, hellaswag/2140, hellaswag/2143, hellaswag/2146, hellaswag/2149, hellaswag/215, hellaswag/2150, hellaswag/2152, hellaswag/2162, hellaswag/2164, hellaswag/2165, hellaswag/2167, hellaswag/2173, hellaswag/2175, hellaswag/2176, hellaswag/2178, hellaswag/218, hellaswag/2182, hellaswag/2183, hellaswag/2187, hellaswag/2188, hellaswag/2189, hellaswag/219, hellaswag/2190, hellaswag/2199, hellaswag/2204, hellaswag/2206, hellaswag/2207, hellaswag/2208, hellaswag/2209, hellaswag/221, hellaswag/2211, hellaswag/2216, hellaswag/2218, hellaswag/2219, hellaswag/2221, hellaswag/2224, hellaswag/2230, hellaswag/2231, hellaswag/2237, hellaswag/2238, hellaswag/224, hellaswag/2240, hellaswag/2245, hellaswag/2246, hellaswag/2249, hellaswag/2251, hellaswag/2253, hellaswag/2255, hellaswag/2259, hellaswag/226, hellaswag/2260, hellaswag/2262, hellaswag/2265, hellaswag/2266, hellaswag/2267, hellaswag/2271, hellaswag/2275, hellaswag/2277, hellaswag/2282, hellaswag/2285, hellaswag/2287, hellaswag/2292, hellaswag/2295, hellaswag/2299, hellaswag/230, hellaswag/2303, hellaswag/2305, hellaswag/2306, hellaswag/2307, hellaswag/2308, hellaswag/2309, hellaswag/231, hellaswag/2312, hellaswag/2316, hellaswag/2319, hellaswag/232, hellaswag/2320, hellaswag/2321, hellaswag/2323, hellaswag/2325, hellaswag/2328, hellaswag/233, hellaswag/2334, hellaswag/2336, hellaswag/2337, hellaswag/234, hellaswag/2340, hellaswag/2343, hellaswag/2346, hellaswag/2347, hellaswag/2348, hellaswag/2349, hellaswag/235, hellaswag/2350, hellaswag/2351, hellaswag/2352, hellaswag/2353, hellaswag/2354, hellaswag/2355, hellaswag/2361, hellaswag/2368, hellaswag/2369, hellaswag/2371, hellaswag/2376, hellaswag/2379, hellaswag/2381, hellaswag/2382, hellaswag/2386, hellaswag/2387, hellaswag/239, hellaswag/2390, hellaswag/2391, hellaswag/2393, hellaswag/2396, hellaswag/2397, hellaswag/2399, hellaswag/24, hellaswag/240, hellaswag/2402, hellaswag/2404, hellaswag/2406, hellaswag/2408, hellaswag/2409, hellaswag/2411, hellaswag/2416, hellaswag/2419, hellaswag/242, hellaswag/2421, hellaswag/2424, hellaswag/2425, hellaswag/2427, hellaswag/2428, hellaswag/2429, hellaswag/2432, hellaswag/2436, hellaswag/2437, hellaswag/2439, hellaswag/2446, hellaswag/245, hellaswag/2450, hellaswag/2451, hellaswag/2454, hellaswag/2455, hellaswag/2459, hellaswag/246, hellaswag/2460, hellaswag/2463, hellaswag/2466, hellaswag/2467, hellaswag/2469, hellaswag/2470, hellaswag/2474, hellaswag/248, hellaswag/2480, hellaswag/2481, hellaswag/2484, hellaswag/2485, hellaswag/2489, hellaswag/2492, hellaswag/2495, hellaswag/2497, hellaswag/2499, hellaswag/25, hellaswag/250, hellaswag/2500, hellaswag/2502, hellaswag/2505, hellaswag/251, hellaswag/2510, hellaswag/2513, hellaswag/2515, hellaswag/2518, hellaswag/252, hellaswag/2521, hellaswag/2523, hellaswag/2525, hellaswag/2526, hellaswag/2528, hellaswag/2536, hellaswag/2537, hellaswag/2543, hellaswag/2546, hellaswag/2549, hellaswag/2552, hellaswag/2556, hellaswag/2557, hellaswag/2559, hellaswag/2560, hellaswag/2561, hellaswag/2563, hellaswag/2564, hellaswag/2565, hellaswag/2566, hellaswag/2568, hellaswag/2571, hellaswag/2572, hellaswag/2575, hellaswag/2576, hellaswag/2577, hellaswag/2579, hellaswag/2580, hellaswag/2583, hellaswag/2585, hellaswag/2586, hellaswag/2587, hellaswag/2589, hellaswag/2592, hellaswag/2594, hellaswag/2596, hellaswag/2597, hellaswag/2598, hellaswag/2599, hellaswag/2600, hellaswag/2602, hellaswag/2606, hellaswag/2608, hellaswag/2609, hellaswag/261, hellaswag/2617, hellaswag/2618, hellaswag/2622, hellaswag/2623, hellaswag/2624, hellaswag/2625, hellaswag/2627, hellaswag/2629, hellaswag/2632, hellaswag/2633, hellaswag/2636, hellaswag/2641, hellaswag/2646, hellaswag/2648, hellaswag/2649, hellaswag/2656, hellaswag/2661, hellaswag/2662, hellaswag/2664, hellaswag/2665, hellaswag/2671, hellaswag/268, hellaswag/2681, hellaswag/2683, hellaswag/2687, hellaswag/2688, hellaswag/2689, hellaswag/269, hellaswag/2690, hellaswag/2691, hellaswag/2693, hellaswag/2694, hellaswag/2697, hellaswag/2699, hellaswag/270, hellaswag/2703, hellaswag/2704, hellaswag/271, hellaswag/2711, hellaswag/2712, hellaswag/2715, hellaswag/2716, hellaswag/2719, hellaswag/2721, hellaswag/2722, hellaswag/2723, hellaswag/2733, hellaswag/2735, hellaswag/2737, hellaswag/2738, hellaswag/2741, hellaswag/2742, hellaswag/2746, hellaswag/2749, hellaswag/2754, hellaswag/2756, hellaswag/2759, hellaswag/2761, hellaswag/2762, hellaswag/2763, hellaswag/2764, hellaswag/2765, hellaswag/2766, hellaswag/2767, hellaswag/2768, hellaswag/2769, hellaswag/2770, hellaswag/2771, hellaswag/2773, hellaswag/2776, hellaswag/2777, hellaswag/278, hellaswag/2783, hellaswag/2785, hellaswag/2787, hellaswag/2789, hellaswag/279, hellaswag/2790, hellaswag/2791, hellaswag/2792, hellaswag/2793, hellaswag/2794, hellaswag/2796, hellaswag/2797, hellaswag/2799, hellaswag/2801, hellaswag/2802, hellaswag/2805, hellaswag/2807, hellaswag/2808, hellaswag/2809, hellaswag/2811, hellaswag/2812, hellaswag/2813, hellaswag/2817, hellaswag/2818, hellaswag/2819, hellaswag/2821, hellaswag/2822, hellaswag/2823, hellaswag/2824, hellaswag/2825, hellaswag/2829, hellaswag/2833, hellaswag/2835, hellaswag/2838, hellaswag/2839, hellaswag/284, hellaswag/2842, hellaswag/2844, hellaswag/2845, hellaswag/2847, hellaswag/2848, hellaswag/285, hellaswag/2851, hellaswag/2852, hellaswag/2853, hellaswag/2855, hellaswag/2856, hellaswag/2858, hellaswag/2859, hellaswag/286, hellaswag/2860, hellaswag/2862, hellaswag/2865, hellaswag/2866, hellaswag/2868, hellaswag/2872, hellaswag/2875, hellaswag/2876, hellaswag/2877, hellaswag/2878, hellaswag/2881, hellaswag/2884, hellaswag/2886, hellaswag/2888, hellaswag/2889, hellaswag/2890, hellaswag/2891, hellaswag/2892, hellaswag/2895, hellaswag/2898, hellaswag/2904, hellaswag/2906, hellaswag/2908, hellaswag/291, hellaswag/2910, hellaswag/2912, hellaswag/2917, hellaswag/2918, hellaswag/2921, hellaswag/293, hellaswag/2930, hellaswag/2933, hellaswag/2934, hellaswag/2938, hellaswag/2942, hellaswag/2944, hellaswag/2945, hellaswag/2950, hellaswag/2951, hellaswag/2954, hellaswag/2955, hellaswag/2956, hellaswag/296, hellaswag/2960, hellaswag/2962, hellaswag/2965, hellaswag/297, hellaswag/2970, hellaswag/2974, hellaswag/2975, hellaswag/2976, hellaswag/2977, hellaswag/2980, hellaswag/2981, hellaswag/2984, hellaswag/2986, hellaswag/299, hellaswag/2990, hellaswag/2996, hellaswag/2997, hellaswag/30, hellaswag/300, hellaswag/3000, hellaswag/3001, hellaswag/3002, hellaswag/3004, hellaswag/3005, hellaswag/3007, hellaswag/3008, hellaswag/3012, hellaswag/3015, hellaswag/3019, hellaswag/302, hellaswag/3020, hellaswag/3021, hellaswag/3022, hellaswag/3023, hellaswag/3029, hellaswag/3030, hellaswag/3032, hellaswag/3035, hellaswag/3037, hellaswag/3040, hellaswag/3041, hellaswag/3042, hellaswag/3045, hellaswag/3046, hellaswag/3047, hellaswag/3049, hellaswag/305, hellaswag/3051, hellaswag/3057, hellaswag/306, hellaswag/3061, hellaswag/3062, hellaswag/3063, hellaswag/3064, hellaswag/3065, hellaswag/3069, hellaswag/307, hellaswag/3075, hellaswag/3083, hellaswag/3084, hellaswag/3086, hellaswag/3090, hellaswag/3092, hellaswag/3095, hellaswag/3099, hellaswag/310, hellaswag/3101, hellaswag/3105, hellaswag/3106, hellaswag/3109, hellaswag/311, hellaswag/3114, hellaswag/3115, hellaswag/3117, hellaswag/3118, hellaswag/312, hellaswag/3122, hellaswag/3125, hellaswag/3126, hellaswag/3127, hellaswag/3130, hellaswag/3133, hellaswag/3135, hellaswag/3136, hellaswag/3137, hellaswag/3138, hellaswag/314, hellaswag/3140, hellaswag/3141, hellaswag/3142, hellaswag/3144, hellaswag/3145, hellaswag/3152, hellaswag/3156, hellaswag/3157, hellaswag/3159, hellaswag/3160, hellaswag/3164, hellaswag/3168, hellaswag/317, hellaswag/3170, hellaswag/3171, hellaswag/3176, hellaswag/3177, hellaswag/3178, hellaswag/3179, hellaswag/3185, hellaswag/3187, hellaswag/3188, hellaswag/3189, hellaswag/3191, hellaswag/3192, hellaswag/3195, hellaswag/3196, hellaswag/3197, hellaswag/3198, hellaswag/3202, hellaswag/3204, hellaswag/3206, hellaswag/3207, hellaswag/3209, hellaswag/3212, hellaswag/3218, hellaswag/322, hellaswag/3220, hellaswag/3225, hellaswag/3227, hellaswag/3228, hellaswag/323, hellaswag/3231, hellaswag/3233, hellaswag/3235, hellaswag/3239, hellaswag/324, hellaswag/3242, hellaswag/3244, hellaswag/3247, hellaswag/3248, hellaswag/3250, hellaswag/3251, hellaswag/3255, hellaswag/3258, hellaswag/3261, hellaswag/3263, hellaswag/3264, hellaswag/3266, hellaswag/3269, hellaswag/327, hellaswag/3273, hellaswag/3274, hellaswag/3275, hellaswag/3277, hellaswag/3278, hellaswag/3279, hellaswag/3280, hellaswag/3281, hellaswag/3282, hellaswag/3284, hellaswag/3287, hellaswag/3288, hellaswag/3289, hellaswag/3291, hellaswag/3292, hellaswag/3293, hellaswag/3294, hellaswag/3295, hellaswag/3297, hellaswag/3298, hellaswag/3299, hellaswag/33, hellaswag/3300, hellaswag/3302, hellaswag/3304, hellaswag/3309, hellaswag/3310, hellaswag/3311, hellaswag/3313, hellaswag/3314, hellaswag/3315, hellaswag/3316, hellaswag/3317, hellaswag/3319, hellaswag/3323, hellaswag/3325, hellaswag/3327, hellaswag/3328, hellaswag/3331, hellaswag/3334, hellaswag/3338, hellaswag/3339, hellaswag/3341, hellaswag/3343, hellaswag/3344, hellaswag/3346, hellaswag/3347, hellaswag/3348, hellaswag/3349, hellaswag/335, hellaswag/3350, hellaswag/3351, hellaswag/3352, hellaswag/3353, hellaswag/3356, hellaswag/3357, hellaswag/3358, hellaswag/336, hellaswag/3361, hellaswag/3362, hellaswag/3364, hellaswag/3366, hellaswag/3367, hellaswag/3368, hellaswag/337, hellaswag/3371, hellaswag/3372, hellaswag/3373, hellaswag/3374, hellaswag/3376, hellaswag/3377, hellaswag/3378, hellaswag/3379, hellaswag/338, hellaswag/3382, hellaswag/3383, hellaswag/3385, hellaswag/3386, hellaswag/3387, hellaswag/3388, hellaswag/3390, hellaswag/3391, hellaswag/3392, hellaswag/3394, hellaswag/3396, hellaswag/3398, hellaswag/340, hellaswag/3400, hellaswag/3401, hellaswag/3402, hellaswag/3404, hellaswag/3406, hellaswag/3407, hellaswag/3409, hellaswag/3410, hellaswag/3412, hellaswag/3413, hellaswag/3414, hellaswag/3415, hellaswag/3417, hellaswag/3418, hellaswag/3419, hellaswag/342, hellaswag/3421, hellaswag/3422, hellaswag/3429, hellaswag/3432, hellaswag/3434, hellaswag/3435, hellaswag/3438, hellaswag/3439, hellaswag/344, hellaswag/3441, hellaswag/3443, hellaswag/3448, hellaswag/3449, hellaswag/345, hellaswag/3452, hellaswag/3453, hellaswag/3455, hellaswag/3457, hellaswag/3459, hellaswag/3460, hellaswag/3461, hellaswag/3462, hellaswag/3465, hellaswag/347, hellaswag/3470, hellaswag/3471, hellaswag/3472, hellaswag/3474, hellaswag/3476, hellaswag/3477, hellaswag/3482, hellaswag/3484, hellaswag/3485, hellaswag/3487, hellaswag/349, hellaswag/3493, hellaswag/3494, hellaswag/3498, hellaswag/3499, hellaswag/3500, hellaswag/3504, hellaswag/3505, hellaswag/3506, hellaswag/3508, hellaswag/351, hellaswag/3510, hellaswag/3513, hellaswag/3514, hellaswag/3515, hellaswag/3517, hellaswag/3518, hellaswag/3519, hellaswag/3520, hellaswag/3522, hellaswag/3525, hellaswag/3526, hellaswag/3527, hellaswag/3529, hellaswag/353, hellaswag/3533, hellaswag/3536, hellaswag/3537, hellaswag/3538, hellaswag/354, hellaswag/3541, hellaswag/3542, hellaswag/3545, hellaswag/3546, hellaswag/3547, hellaswag/3550, hellaswag/3551, hellaswag/3552, hellaswag/3553, hellaswag/3554, hellaswag/3555, hellaswag/3556, hellaswag/3557, hellaswag/3558, hellaswag/3559, hellaswag/3560, hellaswag/3562, hellaswag/3565, hellaswag/3567, hellaswag/3569, hellaswag/357, hellaswag/3571, hellaswag/3572, hellaswag/3574, hellaswag/3575, hellaswag/3576, hellaswag/3579, hellaswag/358, hellaswag/3580, hellaswag/3581, hellaswag/3583, hellaswag/3584, hellaswag/3587, hellaswag/3592, hellaswag/3596, hellaswag/3597, hellaswag/3598, hellaswag/360, hellaswag/3601, hellaswag/3603, hellaswag/3604, hellaswag/3605, hellaswag/3607, hellaswag/3608, hellaswag/3609, hellaswag/3611, hellaswag/3616, hellaswag/3617, hellaswag/3618, hellaswag/3619, hellaswag/3620, hellaswag/3623, hellaswag/3624, hellaswag/3627, hellaswag/3628, hellaswag/363, hellaswag/3630, hellaswag/3633, hellaswag/3634, hellaswag/3636, hellaswag/3637, hellaswag/3638, hellaswag/3639, hellaswag/364, hellaswag/3640, hellaswag/3641, hellaswag/3645, hellaswag/3649, hellaswag/365, hellaswag/3652, hellaswag/3653, hellaswag/3657, hellaswag/3658, hellaswag/3659, hellaswag/3660, hellaswag/3661, hellaswag/3662, hellaswag/3664, hellaswag/3665, hellaswag/3666, hellaswag/3668, hellaswag/3670, hellaswag/3671, hellaswag/3675, hellaswag/368, hellaswag/3680, hellaswag/3681, hellaswag/3682, hellaswag/3683, hellaswag/3686, hellaswag/3687, hellaswag/3689, hellaswag/3692, hellaswag/3693, hellaswag/3694, hellaswag/3695, hellaswag/3699, hellaswag/3700, hellaswag/3701, hellaswag/3702, hellaswag/3703, hellaswag/3705, hellaswag/3706, hellaswag/3707, hellaswag/3708, hellaswag/371, hellaswag/3710, hellaswag/3713, hellaswag/3714, hellaswag/3715, hellaswag/3718, hellaswag/3719, hellaswag/3721, hellaswag/3722, hellaswag/3723, hellaswag/3725, hellaswag/3726, hellaswag/3727, hellaswag/3729, hellaswag/3731, hellaswag/3732, hellaswag/3738, hellaswag/3740, hellaswag/3741, hellaswag/3742, hellaswag/3745, hellaswag/3746, hellaswag/3747, hellaswag/3748, hellaswag/3749, hellaswag/375, hellaswag/3750, hellaswag/3752, hellaswag/3753, hellaswag/3754, hellaswag/3755, hellaswag/3756, hellaswag/3757, hellaswag/3758, hellaswag/3759, hellaswag/3760, hellaswag/3764, hellaswag/3765, hellaswag/3766, hellaswag/3767, hellaswag/3770, hellaswag/3771, hellaswag/3772, hellaswag/3773, hellaswag/3774, hellaswag/3776, hellaswag/3780, hellaswag/3781, hellaswag/3782, hellaswag/3787, hellaswag/3789, hellaswag/3790, hellaswag/3791, hellaswag/3795, hellaswag/3797, hellaswag/3798, hellaswag/380, hellaswag/3800, hellaswag/3801, hellaswag/3802, hellaswag/3803, hellaswag/3804, hellaswag/3806, hellaswag/3808, hellaswag/3810, hellaswag/3814, hellaswag/3815, hellaswag/3818, hellaswag/3819, hellaswag/3822, hellaswag/3823, hellaswag/3826, hellaswag/3828, hellaswag/3829, hellaswag/3830, hellaswag/3832, hellaswag/3833, hellaswag/3835, hellaswag/3836, hellaswag/3838, hellaswag/384, hellaswag/3842, hellaswag/3843, hellaswag/3844, hellaswag/385, hellaswag/3850, hellaswag/3852, hellaswag/3857, hellaswag/3858, hellaswag/3860, hellaswag/3861, hellaswag/3865, hellaswag/3866, hellaswag/3867, hellaswag/3874, hellaswag/3875, hellaswag/3877, hellaswag/3879, hellaswag/3881, hellaswag/3884, hellaswag/3885, hellaswag/3886, hellaswag/3888, hellaswag/389, hellaswag/3890, hellaswag/3891, hellaswag/3892, hellaswag/3893, hellaswag/3895, hellaswag/3896, hellaswag/3897, hellaswag/3898, hellaswag/3901, hellaswag/3902, hellaswag/3904, hellaswag/3905, hellaswag/3906, hellaswag/3907, hellaswag/3908, hellaswag/3909, hellaswag/3911, hellaswag/3913, hellaswag/3914, hellaswag/3915, hellaswag/3917, hellaswag/3918, hellaswag/392, hellaswag/3922, hellaswag/3923, hellaswag/3925, hellaswag/3926, hellaswag/3927, hellaswag/3928, hellaswag/393, hellaswag/3930, hellaswag/3931, hellaswag/3932, hellaswag/3934, hellaswag/3937, hellaswag/3938, hellaswag/3939, hellaswag/3942, hellaswag/3944, hellaswag/3946, hellaswag/3949, hellaswag/395, hellaswag/3951, hellaswag/3952, hellaswag/3953, hellaswag/3954, hellaswag/3957, hellaswag/3958, hellaswag/3959, hellaswag/3960, hellaswag/3961, hellaswag/3962, hellaswag/3963, hellaswag/3964, hellaswag/3965, hellaswag/3966, hellaswag/3969, hellaswag/397, hellaswag/3970, hellaswag/3973, hellaswag/3975, hellaswag/3977, hellaswag/3979, hellaswag/398, hellaswag/3980, hellaswag/3981, hellaswag/3982, hellaswag/3983, hellaswag/3984, hellaswag/3985, hellaswag/3987, hellaswag/3989, hellaswag/3990, hellaswag/3993, hellaswag/3994, hellaswag/3995, hellaswag/3996, hellaswag/3997, hellaswag/3999, hellaswag/4, hellaswag/400, hellaswag/4002, hellaswag/4007, hellaswag/4009, hellaswag/401, hellaswag/4011, hellaswag/4017, hellaswag/4018, hellaswag/402, hellaswag/4021, hellaswag/4024, hellaswag/4025, hellaswag/4026, hellaswag/4027, hellaswag/4028, hellaswag/4038, hellaswag/4039, hellaswag/4040, hellaswag/4041, hellaswag/4042, hellaswag/4043, hellaswag/4044, hellaswag/4045, hellaswag/4046, hellaswag/4049, hellaswag/4053, hellaswag/4054, hellaswag/4055, hellaswag/4056, hellaswag/4057, hellaswag/4058, hellaswag/4059, hellaswag/406, hellaswag/4072, hellaswag/4074, hellaswag/4075, hellaswag/4077, hellaswag/4080, hellaswag/4081, hellaswag/4082, hellaswag/4084, hellaswag/4088, hellaswag/409, hellaswag/4094, hellaswag/4095, hellaswag/4099, hellaswag/410, hellaswag/4100, hellaswag/4103, hellaswag/4105, hellaswag/4106, hellaswag/4109, hellaswag/4112, hellaswag/4113, hellaswag/4116, hellaswag/4118, hellaswag/4119, hellaswag/4120, hellaswag/4125, hellaswag/4132, hellaswag/4135, hellaswag/4137, hellaswag/4138, hellaswag/4139, hellaswag/4140, hellaswag/4141, hellaswag/4142, hellaswag/4143, hellaswag/4144, hellaswag/4145, hellaswag/4146, hellaswag/4149, hellaswag/415, hellaswag/4152, hellaswag/4153, hellaswag/4155, hellaswag/4156, hellaswag/4157, hellaswag/4162, hellaswag/4163, hellaswag/4165, hellaswag/4167, hellaswag/4169, hellaswag/4173, hellaswag/4176, hellaswag/4178, hellaswag/4180, hellaswag/4181, hellaswag/4182, hellaswag/4183, hellaswag/4184, hellaswag/4186, hellaswag/4187, hellaswag/4189, hellaswag/419, hellaswag/4191, hellaswag/4192, hellaswag/4193, hellaswag/4195, hellaswag/4197, hellaswag/4198, hellaswag/4199, hellaswag/4202, hellaswag/4206, hellaswag/4208, hellaswag/421, hellaswag/4211, hellaswag/4215, hellaswag/4218, hellaswag/4219, hellaswag/4220, hellaswag/4222, hellaswag/4224, hellaswag/423, hellaswag/4231, hellaswag/4232, hellaswag/4233, hellaswag/4234, hellaswag/4235, hellaswag/4236, hellaswag/4237, hellaswag/4239, hellaswag/424, hellaswag/4240, hellaswag/4241, hellaswag/4245, hellaswag/4246, hellaswag/425, hellaswag/4250, hellaswag/4251, hellaswag/4257, hellaswag/4259, hellaswag/426, hellaswag/4261, hellaswag/4262, hellaswag/427, hellaswag/4270, hellaswag/4276, hellaswag/4278, hellaswag/4279, hellaswag/428, hellaswag/4285, hellaswag/4286, hellaswag/4289, hellaswag/4291, hellaswag/4292, hellaswag/4293, hellaswag/4294, hellaswag/4296, hellaswag/4298, hellaswag/4300, hellaswag/4301, hellaswag/4302, hellaswag/4305, hellaswag/4306, hellaswag/4308, hellaswag/4309, hellaswag/4310, hellaswag/4311, hellaswag/4315, hellaswag/4316, hellaswag/4318, hellaswag/4319, hellaswag/4320, hellaswag/4322, hellaswag/4323, hellaswag/4326, hellaswag/433, hellaswag/4330, hellaswag/4332, hellaswag/4333, hellaswag/4335, hellaswag/4337, hellaswag/4338, hellaswag/434, hellaswag/4340, hellaswag/4342, hellaswag/4343, hellaswag/4345, hellaswag/4346, hellaswag/4347, hellaswag/4348, hellaswag/4350, hellaswag/4351, hellaswag/4353, hellaswag/4354, hellaswag/4355, hellaswag/4357, hellaswag/4359, hellaswag/436, hellaswag/4360, hellaswag/4361, hellaswag/4362, hellaswag/4364, hellaswag/4365, hellaswag/4366, hellaswag/4368, hellaswag/4369, hellaswag/4373, hellaswag/4374, hellaswag/4375, hellaswag/4378, hellaswag/4380, hellaswag/4381, hellaswag/4383, hellaswag/4385, hellaswag/4386, hellaswag/4387, hellaswag/4388, hellaswag/4390, hellaswag/4392, hellaswag/4396, hellaswag/4398, hellaswag/440, hellaswag/4401, hellaswag/4402, hellaswag/4407, hellaswag/441, hellaswag/4410, hellaswag/4411, hellaswag/4412, hellaswag/4413, hellaswag/4414, hellaswag/4416, hellaswag/4420, hellaswag/4421, hellaswag/4423, hellaswag/4424, hellaswag/4426, hellaswag/4427, hellaswag/443, hellaswag/4430, hellaswag/4431, hellaswag/4433, hellaswag/4434, hellaswag/4436, hellaswag/4437, hellaswag/4440, hellaswag/4441, hellaswag/4442, hellaswag/4443, hellaswag/4444, hellaswag/4446, hellaswag/4447, hellaswag/445, hellaswag/4450, hellaswag/4451, hellaswag/4452, hellaswag/4458, hellaswag/4459, hellaswag/4462, hellaswag/4465, hellaswag/4466, hellaswag/4467, hellaswag/4468, hellaswag/4469, hellaswag/4470, hellaswag/4473, hellaswag/4480, hellaswag/4481, hellaswag/4482, hellaswag/4486, hellaswag/4488, hellaswag/4489, hellaswag/449, hellaswag/4490, hellaswag/4491, hellaswag/4492, hellaswag/4493, hellaswag/4495, hellaswag/4496, hellaswag/4497, hellaswag/4498, hellaswag/4499, hellaswag/4500, hellaswag/4501, hellaswag/4502, hellaswag/4503, hellaswag/4504, hellaswag/4506, hellaswag/4509, hellaswag/451, hellaswag/4510, hellaswag/4512, hellaswag/4513, hellaswag/4516, hellaswag/4517, hellaswag/452, hellaswag/4520, hellaswag/4522, hellaswag/4523, hellaswag/4524, hellaswag/4527, hellaswag/4532, hellaswag/4537, hellaswag/4538, hellaswag/4539, hellaswag/454, hellaswag/4540, hellaswag/4541, hellaswag/4542, hellaswag/4543, hellaswag/4544, hellaswag/4545, hellaswag/4546, hellaswag/4547, hellaswag/4549, hellaswag/455, hellaswag/4550, hellaswag/4551, hellaswag/4554, hellaswag/4555, hellaswag/4556, hellaswag/4557, hellaswag/4558, hellaswag/4563, hellaswag/4564, hellaswag/4566, hellaswag/4569, hellaswag/4571, hellaswag/4574, hellaswag/4575, hellaswag/4577, hellaswag/4578, hellaswag/4579, hellaswag/4581, hellaswag/4582, hellaswag/4583, hellaswag/4584, hellaswag/4585, hellaswag/4586, hellaswag/4587, hellaswag/4588, hellaswag/459, hellaswag/4590, hellaswag/4591, hellaswag/4592, hellaswag/4593, hellaswag/4594, hellaswag/4595, hellaswag/4597, hellaswag/4598, hellaswag/4601, hellaswag/4602, hellaswag/4603, hellaswag/4604, hellaswag/4611, hellaswag/4613, hellaswag/4614, hellaswag/4618, hellaswag/462, hellaswag/4620, hellaswag/4621, hellaswag/4622, hellaswag/4625, hellaswag/4626, hellaswag/4627, hellaswag/4629, hellaswag/463, hellaswag/4630, hellaswag/4631, hellaswag/4632, hellaswag/4633, hellaswag/4635, hellaswag/4639, hellaswag/4641, hellaswag/4642, hellaswag/4643, hellaswag/4645, hellaswag/465, hellaswag/4651, hellaswag/4653, hellaswag/4654, hellaswag/4656, hellaswag/4659, hellaswag/466, hellaswag/4660, hellaswag/4662, hellaswag/4665, hellaswag/4666, hellaswag/4669, hellaswag/467, hellaswag/4671, hellaswag/4673, hellaswag/4674, hellaswag/4675, hellaswag/4677, hellaswag/4679, hellaswag/468, hellaswag/4680, hellaswag/4681, hellaswag/4682, hellaswag/4683, hellaswag/4684, hellaswag/4686, hellaswag/4688, hellaswag/4690, hellaswag/4693, hellaswag/4694, hellaswag/4695, hellaswag/4697, hellaswag/4698, hellaswag/47, hellaswag/4700, hellaswag/4702, hellaswag/4703, hellaswag/4704, hellaswag/4706, hellaswag/4707, hellaswag/4708, hellaswag/471, hellaswag/4710, hellaswag/4712, hellaswag/4713, hellaswag/4714, hellaswag/4716, hellaswag/4718, hellaswag/4722, hellaswag/4723, hellaswag/4727, hellaswag/473, hellaswag/4730, hellaswag/4731, hellaswag/4732, hellaswag/4734, hellaswag/4735, hellaswag/4736, hellaswag/4737, hellaswag/4739, hellaswag/474, hellaswag/4740, hellaswag/4742, hellaswag/4744, hellaswag/4748, hellaswag/4749, hellaswag/475, hellaswag/4750, hellaswag/4752, hellaswag/4753, hellaswag/4754, hellaswag/4755, hellaswag/4756, hellaswag/4758, hellaswag/4760, hellaswag/4763, hellaswag/4764, hellaswag/4767, hellaswag/4769, hellaswag/4771, hellaswag/4772, hellaswag/4773, hellaswag/4774, hellaswag/4775, hellaswag/4776, hellaswag/4777, hellaswag/4780, hellaswag/4781, hellaswag/4782, hellaswag/4784, hellaswag/4785, hellaswag/4788, hellaswag/4789, hellaswag/4790, hellaswag/4792, hellaswag/4795, hellaswag/4797, hellaswag/4798, hellaswag/48, hellaswag/4802, hellaswag/4804, hellaswag/4805, hellaswag/4806, hellaswag/4807, hellaswag/4811, hellaswag/4812, hellaswag/4813, hellaswag/4814, hellaswag/4818, hellaswag/4819, hellaswag/482, hellaswag/4820, hellaswag/4821, hellaswag/4822, hellaswag/4823, hellaswag/4826, hellaswag/4827, hellaswag/4828, hellaswag/4829, hellaswag/4830, hellaswag/4832, hellaswag/4836, hellaswag/4837, hellaswag/4838, hellaswag/484, hellaswag/4841, hellaswag/4842, hellaswag/4846, hellaswag/4847, hellaswag/4848, hellaswag/4849, hellaswag/485, hellaswag/4852, hellaswag/4854, hellaswag/4857, hellaswag/4858, hellaswag/486, hellaswag/4862, hellaswag/4864, hellaswag/4866, hellaswag/4869, hellaswag/487, hellaswag/4873, hellaswag/4874, hellaswag/4875, hellaswag/4879, hellaswag/4880, hellaswag/4881, hellaswag/4884, hellaswag/4885, hellaswag/4887, hellaswag/4890, hellaswag/4891, hellaswag/4892, hellaswag/4893, hellaswag/4894, hellaswag/4897, hellaswag/4899, hellaswag/4904, hellaswag/4905, hellaswag/4906, hellaswag/4909, hellaswag/4911, hellaswag/4913, hellaswag/4919, hellaswag/4921, hellaswag/4923, hellaswag/4926, hellaswag/4930, hellaswag/4933, hellaswag/4934, hellaswag/4935, hellaswag/4936, hellaswag/4937, hellaswag/4941, hellaswag/4942, hellaswag/4943, hellaswag/4944, hellaswag/4949, hellaswag/4950, hellaswag/4951, hellaswag/4953, hellaswag/4956, hellaswag/4957, hellaswag/4958, hellaswag/4959, hellaswag/4963, hellaswag/4967, hellaswag/4969, hellaswag/497, hellaswag/4973, hellaswag/4976, hellaswag/4978, hellaswag/4979, hellaswag/498, hellaswag/4980, hellaswag/4981, hellaswag/4982, hellaswag/4985, hellaswag/4987, hellaswag/4988, hellaswag/4990, hellaswag/4991, hellaswag/4993, hellaswag/4994, hellaswag/4995, hellaswag/4997, hellaswag/4998, hellaswag/5, hellaswag/50, hellaswag/5000, hellaswag/5001, hellaswag/5004, hellaswag/5006, hellaswag/5008, hellaswag/5009, hellaswag/501, hellaswag/5011, hellaswag/5012, hellaswag/5013, hellaswag/5014, hellaswag/5015, hellaswag/502, hellaswag/5020, hellaswag/5021, hellaswag/5022, hellaswag/5023, hellaswag/5024, hellaswag/5026, hellaswag/5029, hellaswag/5030, hellaswag/5031, hellaswag/5033, hellaswag/5034, hellaswag/5037, hellaswag/5038, hellaswag/504, hellaswag/5040, hellaswag/5041, hellaswag/5044, hellaswag/5045, hellaswag/5048, hellaswag/5049, hellaswag/505, hellaswag/5050, hellaswag/5051, hellaswag/5053, hellaswag/5055, hellaswag/5057, hellaswag/5058, hellaswag/506, hellaswag/5061, hellaswag/5063, hellaswag/5065, hellaswag/5067, hellaswag/5068, hellaswag/5070, hellaswag/5071, hellaswag/5072, hellaswag/5073, hellaswag/5076, hellaswag/5077, hellaswag/5078, hellaswag/5083, hellaswag/5084, hellaswag/5087, hellaswag/5089, hellaswag/509, hellaswag/5090, hellaswag/5095, hellaswag/5096, hellaswag/5099, hellaswag/510, hellaswag/5100, hellaswag/5105, hellaswag/5107, hellaswag/5109, hellaswag/5110, hellaswag/5113, hellaswag/5115, hellaswag/5116, hellaswag/5117, hellaswag/5118, hellaswag/512, hellaswag/5120, hellaswag/5121, hellaswag/5123, hellaswag/5124, hellaswag/5125, hellaswag/5126, hellaswag/5127, hellaswag/5128, hellaswag/5129, hellaswag/513, hellaswag/5130, hellaswag/5131, hellaswag/5132, hellaswag/5133, hellaswag/5134, hellaswag/5135, hellaswag/5138, hellaswag/5139, hellaswag/514, hellaswag/5141, hellaswag/5145, hellaswag/5148, hellaswag/5149, hellaswag/515, hellaswag/5150, hellaswag/5151, hellaswag/5153, hellaswag/5154, hellaswag/5156, hellaswag/5158, hellaswag/5160, hellaswag/5161, hellaswag/5163, hellaswag/5166, hellaswag/5169, hellaswag/517, hellaswag/5170, hellaswag/5172, hellaswag/5175, hellaswag/5177, hellaswag/5180, hellaswag/5182, hellaswag/5183, hellaswag/5185, hellaswag/5187, hellaswag/5193, hellaswag/5195, hellaswag/5197, hellaswag/5198, hellaswag/5199, hellaswag/5200, hellaswag/5203, hellaswag/5205, hellaswag/5206, hellaswag/5207, hellaswag/5209, hellaswag/5210, hellaswag/5216, hellaswag/5219, hellaswag/522, hellaswag/5221, hellaswag/5222, hellaswag/5223, hellaswag/5224, hellaswag/5225, hellaswag/5226, hellaswag/5229, hellaswag/523, hellaswag/5232, hellaswag/5234, hellaswag/5235, hellaswag/5237, hellaswag/524, hellaswag/5241, hellaswag/5243, hellaswag/5244, hellaswag/5247, hellaswag/5248, hellaswag/5250, hellaswag/5254, hellaswag/5256, hellaswag/5257, hellaswag/5259, hellaswag/5260, hellaswag/5261, hellaswag/5264, hellaswag/5270, hellaswag/5271, hellaswag/5273, hellaswag/5274, hellaswag/5275, hellaswag/5279, hellaswag/5280, hellaswag/5282, hellaswag/5283, hellaswag/5284, hellaswag/5286, hellaswag/5289, hellaswag/529, hellaswag/5290, hellaswag/5291, hellaswag/5292, hellaswag/5293, hellaswag/5294, hellaswag/5298, hellaswag/53, hellaswag/530, hellaswag/5300, hellaswag/5301, hellaswag/5302, hellaswag/5303, hellaswag/5304, hellaswag/5306, hellaswag/5310, hellaswag/5311, hellaswag/5313, hellaswag/5315, hellaswag/5317, hellaswag/5319, hellaswag/5321, hellaswag/5322, hellaswag/5323, hellaswag/5324, hellaswag/5326, hellaswag/5327, hellaswag/5330, hellaswag/5331, hellaswag/5333, hellaswag/5334, hellaswag/5338, hellaswag/534, hellaswag/5341, hellaswag/5342, hellaswag/5345, hellaswag/5346, hellaswag/5349, hellaswag/5352, hellaswag/5353, hellaswag/5356, hellaswag/5357, hellaswag/5358, hellaswag/536, hellaswag/5360, hellaswag/5361, hellaswag/5362, hellaswag/5363, hellaswag/5366, hellaswag/5367, hellaswag/537, hellaswag/5370, hellaswag/5373, hellaswag/5374, hellaswag/5375, hellaswag/5376, hellaswag/5377, hellaswag/5378, hellaswag/5380, hellaswag/5383, hellaswag/5385, hellaswag/5388, hellaswag/5389, hellaswag/5391, hellaswag/5392, hellaswag/5393, hellaswag/5394, hellaswag/5395, hellaswag/5396, hellaswag/5397, hellaswag/5398, hellaswag/54, hellaswag/5400, hellaswag/5401, hellaswag/5403, hellaswag/5404, hellaswag/5405, hellaswag/5407, hellaswag/5412, hellaswag/5414, hellaswag/5415, hellaswag/5420, hellaswag/5421, hellaswag/5422, hellaswag/5424, hellaswag/5427, hellaswag/5430, hellaswag/5434, hellaswag/5435, hellaswag/5436, hellaswag/5438, hellaswag/5446, hellaswag/5447, hellaswag/545, hellaswag/5451, hellaswag/5453, hellaswag/5456, hellaswag/5457, hellaswag/546, hellaswag/5461, hellaswag/5462, hellaswag/5464, hellaswag/5469, hellaswag/5471, hellaswag/5477, hellaswag/5478, hellaswag/5479, hellaswag/5480, hellaswag/5481, hellaswag/5482, hellaswag/5483, hellaswag/5484, hellaswag/5488, hellaswag/5489, hellaswag/549, hellaswag/5492, hellaswag/5493, hellaswag/5494, hellaswag/5496, hellaswag/5497, hellaswag/5498, hellaswag/5499, hellaswag/550, hellaswag/5502, hellaswag/5503, hellaswag/5505, hellaswag/5511, hellaswag/5512, hellaswag/5513, hellaswag/5514, hellaswag/5515, hellaswag/5516, hellaswag/5517, hellaswag/5518, hellaswag/5519, hellaswag/552, hellaswag/5524, hellaswag/5527, hellaswag/5529, hellaswag/5531, hellaswag/5537, hellaswag/5539, hellaswag/554, hellaswag/5540, hellaswag/5543, hellaswag/5544, hellaswag/5549, hellaswag/555, hellaswag/5550, hellaswag/5552, hellaswag/5554, hellaswag/5556, hellaswag/5557, hellaswag/5560, hellaswag/5561, hellaswag/5564, hellaswag/5567, hellaswag/5568, hellaswag/5569, hellaswag/5572, hellaswag/5574, hellaswag/5575, hellaswag/558, hellaswag/5580, hellaswag/5583, hellaswag/5584, hellaswag/5587, hellaswag/5591, hellaswag/5592, hellaswag/5593, hellaswag/5599, hellaswag/5602, hellaswag/5605, hellaswag/5607, hellaswag/5608, hellaswag/561, hellaswag/5611, hellaswag/5615, hellaswag/5617, hellaswag/5618, hellaswag/5619, hellaswag/562, hellaswag/5622, hellaswag/5624, hellaswag/5627, hellaswag/5628, hellaswag/5629, hellaswag/563, hellaswag/5630, hellaswag/5632, hellaswag/5633, hellaswag/5635, hellaswag/5636, hellaswag/5639, hellaswag/564, hellaswag/5640, hellaswag/5642, hellaswag/5643, hellaswag/5644, hellaswag/5646, hellaswag/5647, hellaswag/5650, hellaswag/5651, hellaswag/5656, hellaswag/5658, hellaswag/566, hellaswag/5661, hellaswag/5664, hellaswag/5665, hellaswag/5669, hellaswag/5670, hellaswag/5672, hellaswag/5673, hellaswag/5674, hellaswag/5675, hellaswag/5677, hellaswag/5679, hellaswag/5680, hellaswag/5682, hellaswag/5683, hellaswag/5687, hellaswag/5690, hellaswag/5691, hellaswag/5692, hellaswag/5693, hellaswag/5697, hellaswag/5698, hellaswag/5699, hellaswag/570, hellaswag/5702, hellaswag/5707, hellaswag/5708, hellaswag/5709, hellaswag/5710, hellaswag/5712, hellaswag/5713, hellaswag/5714, hellaswag/5718, hellaswag/5719, hellaswag/5722, hellaswag/5724, hellaswag/5726, hellaswag/5727, hellaswag/5729, hellaswag/5732, hellaswag/5734, hellaswag/5735, hellaswag/5737, hellaswag/5739, hellaswag/574, hellaswag/5740, hellaswag/5742, hellaswag/5743, hellaswag/5744, hellaswag/5745, hellaswag/5748, hellaswag/5749, hellaswag/5751, hellaswag/5754, hellaswag/5758, hellaswag/5759, hellaswag/576, hellaswag/5760, hellaswag/5762, hellaswag/5767, hellaswag/5769, hellaswag/577, hellaswag/5770, hellaswag/5773, hellaswag/5775, hellaswag/5779, hellaswag/578, hellaswag/5780, hellaswag/5781, hellaswag/5784, hellaswag/5785, hellaswag/5788, hellaswag/5789, hellaswag/579, hellaswag/5790, hellaswag/5794, hellaswag/5795, hellaswag/5797, hellaswag/58, hellaswag/5802, hellaswag/5805, hellaswag/5806, hellaswag/5808, hellaswag/5809, hellaswag/581, hellaswag/5814, hellaswag/5816, hellaswag/5817, hellaswag/5818, hellaswag/5819, hellaswag/5820, hellaswag/5821, hellaswag/5825, hellaswag/583, hellaswag/5832, hellaswag/5833, hellaswag/5836, hellaswag/5837, hellaswag/5839, hellaswag/584, hellaswag/5843, hellaswag/5844, hellaswag/5846, hellaswag/5852, hellaswag/5855, hellaswag/5856, hellaswag/5857, hellaswag/5859, hellaswag/5861, hellaswag/5863, hellaswag/5865, hellaswag/5866, hellaswag/5867, hellaswag/5868, hellaswag/5871, hellaswag/5872, hellaswag/5874, hellaswag/5877, hellaswag/5878, hellaswag/5879, hellaswag/5880, hellaswag/5881, hellaswag/5882, hellaswag/5883, hellaswag/5885, hellaswag/5886, hellaswag/5887, hellaswag/5891, hellaswag/5893, hellaswag/5894, hellaswag/5895, hellaswag/5896, hellaswag/5898, hellaswag/59, hellaswag/5900, hellaswag/5901, hellaswag/5904, hellaswag/5905, hellaswag/591, hellaswag/5910, hellaswag/5912, hellaswag/5913, hellaswag/5914, hellaswag/5916, hellaswag/5922, hellaswag/5923, hellaswag/5925, hellaswag/5927, hellaswag/5929, hellaswag/593, hellaswag/5931, hellaswag/5932, hellaswag/5935, hellaswag/5938, hellaswag/5940, hellaswag/5941, hellaswag/5943, hellaswag/5944, hellaswag/5945, hellaswag/5947, hellaswag/5952, hellaswag/5954, hellaswag/5955, hellaswag/5956, hellaswag/5957, hellaswag/5958, hellaswag/5959, hellaswag/5961, hellaswag/5964, hellaswag/5965, hellaswag/5966, hellaswag/597, hellaswag/5970, hellaswag/5971, hellaswag/5972, hellaswag/5974, hellaswag/5976, hellaswag/5978, hellaswag/5979, hellaswag/5980, hellaswag/5981, hellaswag/5982, hellaswag/5983, hellaswag/5986, hellaswag/5990, hellaswag/5992, hellaswag/5993, hellaswag/5995, hellaswag/5996, hellaswag/5999, hellaswag/6, hellaswag/60, hellaswag/6000, hellaswag/6001, hellaswag/6002, hellaswag/6005, hellaswag/6006, hellaswag/6007, hellaswag/6011, hellaswag/6017, hellaswag/6019, hellaswag/6020, hellaswag/6024, hellaswag/6025, hellaswag/6026, hellaswag/6027, hellaswag/6028, hellaswag/6029, hellaswag/6030, hellaswag/6031, hellaswag/6034, hellaswag/6035, hellaswag/6038, hellaswag/6039, hellaswag/6040, hellaswag/6041, hellaswag/6042, hellaswag/6043, hellaswag/6044, hellaswag/6047, hellaswag/6049, hellaswag/605, hellaswag/6052, hellaswag/6053, hellaswag/6054, hellaswag/6056, hellaswag/6059, hellaswag/6060, hellaswag/6061, hellaswag/6062, hellaswag/6063, hellaswag/6064, hellaswag/6066, hellaswag/6067, hellaswag/6069, hellaswag/6070, hellaswag/6071, hellaswag/6073, hellaswag/6079, hellaswag/6082, hellaswag/6083, hellaswag/6084, hellaswag/6086, hellaswag/609, hellaswag/6092, hellaswag/6095, hellaswag/6096, hellaswag/6098, hellaswag/61, hellaswag/610, hellaswag/6101, hellaswag/6103, hellaswag/6109, hellaswag/6113, hellaswag/6116, hellaswag/6118, hellaswag/6119, hellaswag/612, hellaswag/6120, hellaswag/6121, hellaswag/6123, hellaswag/6127, hellaswag/6128, hellaswag/6130, hellaswag/6131, hellaswag/6132, hellaswag/6134, hellaswag/6135, hellaswag/6136, hellaswag/6138, hellaswag/6139, hellaswag/614, hellaswag/6141, hellaswag/6142, hellaswag/6146, hellaswag/6150, hellaswag/6151, hellaswag/6152, hellaswag/6153, hellaswag/6157, hellaswag/6159, hellaswag/616, hellaswag/6160, hellaswag/6161, hellaswag/6162, hellaswag/6164, hellaswag/6166, hellaswag/6168, hellaswag/6169, hellaswag/617, hellaswag/6170, hellaswag/6171, hellaswag/6172, hellaswag/6173, hellaswag/6174, hellaswag/6175, hellaswag/6177, hellaswag/6178, hellaswag/6179, hellaswag/6180, hellaswag/6183, hellaswag/6186, hellaswag/6187, hellaswag/6188, hellaswag/6190, hellaswag/6192, hellaswag/6194, hellaswag/6197, hellaswag/6198, hellaswag/6199, hellaswag/62, hellaswag/620, hellaswag/6200, hellaswag/6204, hellaswag/6205, hellaswag/6206, hellaswag/6208, hellaswag/6210, hellaswag/6211, hellaswag/6212, hellaswag/6214, hellaswag/6215, hellaswag/6218, hellaswag/6222, hellaswag/6223, hellaswag/6226, hellaswag/6228, hellaswag/6229, hellaswag/6230, hellaswag/6231, hellaswag/6233, hellaswag/6234, hellaswag/6235, hellaswag/6236, hellaswag/6241, hellaswag/6242, hellaswag/6243, hellaswag/6244, hellaswag/6247, hellaswag/6250, hellaswag/6251, hellaswag/6253, hellaswag/6258, hellaswag/6259, hellaswag/6261, hellaswag/6262, hellaswag/6263, hellaswag/6266, hellaswag/6268, hellaswag/6271, hellaswag/6272, hellaswag/6273, hellaswag/6275, hellaswag/6277, hellaswag/6279, hellaswag/6280, hellaswag/6281, hellaswag/6283, hellaswag/6285, hellaswag/6286, hellaswag/6289, hellaswag/629, hellaswag/6290, hellaswag/6291, hellaswag/6292, hellaswag/6293, hellaswag/6294, hellaswag/6295, hellaswag/6296, hellaswag/6297, hellaswag/6298, hellaswag/630, hellaswag/6301, hellaswag/6302, hellaswag/6304, hellaswag/6305, hellaswag/6306, hellaswag/6307, hellaswag/6308, hellaswag/6309, hellaswag/6312, hellaswag/6313, hellaswag/6314, hellaswag/6316, hellaswag/6317, hellaswag/6320, hellaswag/6321, hellaswag/6323, hellaswag/6325, hellaswag/6326, hellaswag/6327, hellaswag/6328, hellaswag/6329, hellaswag/633, hellaswag/6330, hellaswag/6331, hellaswag/6332, hellaswag/6336, hellaswag/6337, hellaswag/6338, hellaswag/6339, hellaswag/634, hellaswag/6341, hellaswag/6344, hellaswag/6345, hellaswag/6349, hellaswag/6353, hellaswag/6356, hellaswag/6357, hellaswag/6358, hellaswag/6362, hellaswag/6363, hellaswag/6364, hellaswag/6365, hellaswag/6366, hellaswag/6368, hellaswag/6372, hellaswag/6375, hellaswag/6376, hellaswag/6377, hellaswag/638, hellaswag/6380, hellaswag/6381, hellaswag/6382, hellaswag/6383, hellaswag/6385, hellaswag/6388, hellaswag/6390, hellaswag/6394, hellaswag/6395, hellaswag/6398, hellaswag/6399, hellaswag/64, hellaswag/6400, hellaswag/6402, hellaswag/6404, hellaswag/6405, hellaswag/6406, hellaswag/6407, hellaswag/6408, hellaswag/641, hellaswag/6410, hellaswag/6413, hellaswag/6415, hellaswag/6416, hellaswag/6417, hellaswag/6418, hellaswag/642, hellaswag/6422, hellaswag/6424, hellaswag/6427, hellaswag/6429, hellaswag/6430, hellaswag/6431, hellaswag/6432, hellaswag/6433, hellaswag/6436, hellaswag/6437, hellaswag/6438, hellaswag/6439, hellaswag/6440, hellaswag/6443, hellaswag/6444, hellaswag/6446, hellaswag/6448, hellaswag/6449, hellaswag/645, hellaswag/6450, hellaswag/6451, hellaswag/6453, hellaswag/6456, hellaswag/6458, hellaswag/6460, hellaswag/6465, hellaswag/6467, hellaswag/6470, hellaswag/6478, hellaswag/6479, hellaswag/648, hellaswag/6480, hellaswag/6481, hellaswag/6482, hellaswag/6483, hellaswag/6484, hellaswag/6485, hellaswag/6486, hellaswag/6487, hellaswag/6488, hellaswag/6489, hellaswag/6490, hellaswag/6492, hellaswag/6493, hellaswag/6498, hellaswag/6499, hellaswag/6500, hellaswag/6501, hellaswag/6506, hellaswag/6507, hellaswag/6508, hellaswag/6509, hellaswag/651, hellaswag/6510, hellaswag/6513, hellaswag/6514, hellaswag/6518, hellaswag/6520, hellaswag/6521, hellaswag/6527, hellaswag/6529, hellaswag/653, hellaswag/6530, hellaswag/6533, hellaswag/6534, hellaswag/6537, hellaswag/6538, hellaswag/6539, hellaswag/6540, hellaswag/6541, hellaswag/6545, hellaswag/6547, hellaswag/6548, hellaswag/6549, hellaswag/6551, hellaswag/6552, hellaswag/6555, hellaswag/6556, hellaswag/6564, hellaswag/6565, hellaswag/6566, hellaswag/6567, hellaswag/6568, hellaswag/657, hellaswag/6572, hellaswag/6575, hellaswag/6578, hellaswag/6579, hellaswag/658, hellaswag/6581, hellaswag/6582, hellaswag/6584, hellaswag/6585, hellaswag/6587, hellaswag/6588, hellaswag/6589, hellaswag/6591, hellaswag/6592, hellaswag/6593, hellaswag/6596, hellaswag/6598, hellaswag/66, hellaswag/6600, hellaswag/6602, hellaswag/6604, hellaswag/6605, hellaswag/6606, hellaswag/6608, hellaswag/661, hellaswag/6611, hellaswag/6612, hellaswag/6614, hellaswag/6615, hellaswag/6618, hellaswag/6620, hellaswag/6621, hellaswag/6623, hellaswag/6624, hellaswag/6625, hellaswag/6626, hellaswag/6627, hellaswag/6631, hellaswag/6633, hellaswag/6634, hellaswag/6635, hellaswag/6636, hellaswag/6637, hellaswag/6638, hellaswag/6643, hellaswag/6644, hellaswag/6646, hellaswag/6648, hellaswag/6649, hellaswag/665, hellaswag/6650, hellaswag/6651, hellaswag/6654, hellaswag/6656, hellaswag/6659, hellaswag/6663, hellaswag/6664, hellaswag/6665, hellaswag/6668, hellaswag/667, hellaswag/6670, hellaswag/6672, hellaswag/6673, hellaswag/6675, hellaswag/6676, hellaswag/6678, hellaswag/6679, hellaswag/668, hellaswag/6681, hellaswag/6683, hellaswag/6684, hellaswag/6688, hellaswag/669, hellaswag/6690, hellaswag/6693, hellaswag/6694, hellaswag/6695, hellaswag/6697, hellaswag/6700, hellaswag/6701, hellaswag/6702, hellaswag/6703, hellaswag/6706, hellaswag/6709, hellaswag/671, hellaswag/6710, hellaswag/6711, hellaswag/6712, hellaswag/6714, hellaswag/6716, hellaswag/6717, hellaswag/6718, hellaswag/6719, hellaswag/672, hellaswag/6720, hellaswag/6722, hellaswag/6724, hellaswag/6725, hellaswag/6726, hellaswag/6728, hellaswag/6729, hellaswag/673, hellaswag/6730, hellaswag/6731, hellaswag/6732, hellaswag/6733, hellaswag/6737, hellaswag/6738, hellaswag/6739, hellaswag/674, hellaswag/6741, hellaswag/6742, hellaswag/6743, hellaswag/6744, hellaswag/6746, hellaswag/6747, hellaswag/6748, hellaswag/6750, hellaswag/6752, hellaswag/6756, hellaswag/6757, hellaswag/6758, hellaswag/676, hellaswag/6760, hellaswag/6761, hellaswag/6762, hellaswag/6763, hellaswag/6765, hellaswag/6766, hellaswag/6767, hellaswag/677, hellaswag/6770, hellaswag/6771, hellaswag/6774, hellaswag/6777, hellaswag/6779, hellaswag/6780, hellaswag/6781, hellaswag/6784, hellaswag/6785, hellaswag/6786, hellaswag/6789, hellaswag/679, hellaswag/6790, hellaswag/6791, hellaswag/6792, hellaswag/6793, hellaswag/6798, hellaswag/6799, hellaswag/68, hellaswag/6802, hellaswag/6804, hellaswag/6807, hellaswag/6810, hellaswag/6811, hellaswag/6812, hellaswag/6815, hellaswag/6816, hellaswag/6819, hellaswag/6820, hellaswag/6823, hellaswag/6825, hellaswag/6827, hellaswag/6833, hellaswag/6834, hellaswag/6837, hellaswag/6839, hellaswag/684, hellaswag/6842, hellaswag/6843, hellaswag/6844, hellaswag/6845, hellaswag/6847, hellaswag/6848, hellaswag/6849, hellaswag/685, hellaswag/6853, hellaswag/6855, hellaswag/6856, hellaswag/6858, hellaswag/6859, hellaswag/686, hellaswag/6861, hellaswag/6862, hellaswag/6865, hellaswag/6869, hellaswag/6870, hellaswag/6871, hellaswag/6873, hellaswag/6874, hellaswag/6876, hellaswag/6877, hellaswag/6878, hellaswag/688, hellaswag/6881, hellaswag/6882, hellaswag/6883, hellaswag/6886, hellaswag/6887, hellaswag/6888, hellaswag/6890, hellaswag/6891, hellaswag/6893, hellaswag/6895, hellaswag/6898, hellaswag/6900, hellaswag/6903, hellaswag/6904, hellaswag/6905, hellaswag/6907, hellaswag/691, hellaswag/6910, hellaswag/6912, hellaswag/6913, hellaswag/6914, hellaswag/6915, hellaswag/6918, hellaswag/692, hellaswag/6923, hellaswag/6924, hellaswag/6926, hellaswag/6927, hellaswag/6929, hellaswag/6935, hellaswag/6936, hellaswag/6937, hellaswag/6938, hellaswag/6939, hellaswag/6940, hellaswag/6943, hellaswag/6944, hellaswag/6945, hellaswag/6946, hellaswag/6947, hellaswag/6951, hellaswag/6961, hellaswag/6963, hellaswag/6964, hellaswag/6965, hellaswag/6966, hellaswag/6969, hellaswag/697, hellaswag/6970, hellaswag/6971, hellaswag/6975, hellaswag/6976, hellaswag/6978, hellaswag/698, hellaswag/6980, hellaswag/6981, hellaswag/6982, hellaswag/6983, hellaswag/6984, hellaswag/6986, hellaswag/6987, hellaswag/6988, hellaswag/6989, hellaswag/6991, hellaswag/6996, hellaswag/6998, hellaswag/6999, hellaswag/7, hellaswag/70, hellaswag/7000, hellaswag/7001, hellaswag/7002, hellaswag/7003, hellaswag/7004, hellaswag/7006, hellaswag/7008, hellaswag/7009, hellaswag/7012, hellaswag/7013, hellaswag/7017, hellaswag/7018, hellaswag/702, hellaswag/7020, hellaswag/7021, hellaswag/7022, hellaswag/7023, hellaswag/7024, hellaswag/7026, hellaswag/7028, hellaswag/7029, hellaswag/703, hellaswag/7031, hellaswag/7032, hellaswag/7033, hellaswag/7034, hellaswag/7035, hellaswag/7036, hellaswag/7037, hellaswag/7039, hellaswag/7040, hellaswag/7043, hellaswag/7044, hellaswag/7045, hellaswag/7047, hellaswag/7048, hellaswag/705, hellaswag/7051, hellaswag/7052, hellaswag/7053, hellaswag/7055, hellaswag/7056, hellaswag/7057, hellaswag/706, hellaswag/7060, hellaswag/7061, hellaswag/7065, hellaswag/707, hellaswag/7070, hellaswag/7072, hellaswag/7073, hellaswag/7076, hellaswag/7077, hellaswag/7079, hellaswag/708, hellaswag/7080, hellaswag/7083, hellaswag/7084, hellaswag/7085, hellaswag/7088, hellaswag/7089, hellaswag/709, hellaswag/7090, hellaswag/7091, hellaswag/7092, hellaswag/7096, hellaswag/7097, hellaswag/7098, hellaswag/7099, hellaswag/71, hellaswag/7100, hellaswag/7102, hellaswag/7104, hellaswag/7105, hellaswag/7107, hellaswag/7108, hellaswag/7109, hellaswag/7113, hellaswag/7114, hellaswag/7117, hellaswag/7118, hellaswag/712, hellaswag/7122, hellaswag/7124, hellaswag/7125, hellaswag/7128, hellaswag/7129, hellaswag/713, hellaswag/7130, hellaswag/7132, hellaswag/7133, hellaswag/7134, hellaswag/7135, hellaswag/7137, hellaswag/7138, hellaswag/7141, hellaswag/7142, hellaswag/7145, hellaswag/7148, hellaswag/7151, hellaswag/7154, hellaswag/7160, hellaswag/7163, hellaswag/7164, hellaswag/7165, hellaswag/7167, hellaswag/7171, hellaswag/7173, hellaswag/7174, hellaswag/7175, hellaswag/7177, hellaswag/7180, hellaswag/7183, hellaswag/7184, hellaswag/7185, hellaswag/7187, hellaswag/7188, hellaswag/7191, hellaswag/7192, hellaswag/7193, hellaswag/7194, hellaswag/7196, hellaswag/7198, hellaswag/7199, hellaswag/7203, hellaswag/7205, hellaswag/7206, hellaswag/7209, hellaswag/7211, hellaswag/7212, hellaswag/7214, hellaswag/7215, hellaswag/7216, hellaswag/7217, hellaswag/7219, hellaswag/7221, hellaswag/7222, hellaswag/7225, hellaswag/7226, hellaswag/7227, hellaswag/7228, hellaswag/7229, hellaswag/7232, hellaswag/7234, hellaswag/7235, hellaswag/7237, hellaswag/724, hellaswag/7241, hellaswag/7242, hellaswag/7245, hellaswag/7246, hellaswag/7248, hellaswag/7250, hellaswag/7252, hellaswag/7253, hellaswag/7256, hellaswag/7257, hellaswag/726, hellaswag/7260, hellaswag/7261, hellaswag/7265, hellaswag/7266, hellaswag/7267, hellaswag/7268, hellaswag/7269, hellaswag/727, hellaswag/7271, hellaswag/7273, hellaswag/7274, hellaswag/7279, hellaswag/728, hellaswag/7280, hellaswag/7283, hellaswag/7285, hellaswag/7286, hellaswag/7287, hellaswag/7290, hellaswag/7291, hellaswag/7293, hellaswag/7294, hellaswag/7295, hellaswag/7298, hellaswag/730, hellaswag/7301, hellaswag/7302, hellaswag/7305, hellaswag/7307, hellaswag/7309, hellaswag/7313, hellaswag/7316, hellaswag/7317, hellaswag/732, hellaswag/7322, hellaswag/7324, hellaswag/7328, hellaswag/7329, hellaswag/733, hellaswag/7330, hellaswag/7332, hellaswag/7335, hellaswag/7336, hellaswag/7339, hellaswag/7340, hellaswag/7341, hellaswag/7342, hellaswag/7343, hellaswag/7344, hellaswag/7346, hellaswag/7348, hellaswag/7349, hellaswag/7351, hellaswag/7352, hellaswag/7354, hellaswag/7355, hellaswag/7356, hellaswag/7357, hellaswag/7358, hellaswag/7359, hellaswag/736, hellaswag/7361, hellaswag/7362, hellaswag/7363, hellaswag/7364, hellaswag/7365, hellaswag/7366, hellaswag/7367, hellaswag/7374, hellaswag/7376, hellaswag/7379, hellaswag/7381, hellaswag/7382, hellaswag/7383, hellaswag/7384, hellaswag/7386, hellaswag/7389, hellaswag/7391, hellaswag/7393, hellaswag/7395, hellaswag/7398, hellaswag/7399, hellaswag/740, hellaswag/7401, hellaswag/7402, hellaswag/7403, hellaswag/7404, hellaswag/7405, hellaswag/7408, hellaswag/7411, hellaswag/7412, hellaswag/7413, hellaswag/7415, hellaswag/7417, hellaswag/7418, hellaswag/7419, hellaswag/7420, hellaswag/7421, hellaswag/7422, hellaswag/7423, hellaswag/7424, hellaswag/7429, hellaswag/7430, hellaswag/7432, hellaswag/7433, hellaswag/7436, hellaswag/7437, hellaswag/7438, hellaswag/7439, hellaswag/744, hellaswag/7442, hellaswag/7443, hellaswag/7446, hellaswag/7447, hellaswag/7448, hellaswag/7451, hellaswag/7452, hellaswag/7454, hellaswag/7456, hellaswag/7458, hellaswag/7459, hellaswag/7460, hellaswag/7463, hellaswag/7464, hellaswag/7465, hellaswag/7466, hellaswag/747, hellaswag/7470, hellaswag/7472, hellaswag/7474, hellaswag/7477, hellaswag/7479, hellaswag/7480, hellaswag/7481, hellaswag/7482, hellaswag/7483, hellaswag/7485, hellaswag/7486, hellaswag/7488, hellaswag/7489, hellaswag/7497, hellaswag/7498, hellaswag/750, hellaswag/7501, hellaswag/7502, hellaswag/7503, hellaswag/7506, hellaswag/7509, hellaswag/7510, hellaswag/7512, hellaswag/7516, hellaswag/7517, hellaswag/7518, hellaswag/7519, hellaswag/752, hellaswag/7521, hellaswag/7523, hellaswag/7524, hellaswag/7526, hellaswag/7527, hellaswag/7528, hellaswag/7529, hellaswag/7531, hellaswag/7533, hellaswag/7534, hellaswag/7535, hellaswag/7539, hellaswag/754, hellaswag/7541, hellaswag/7544, hellaswag/7545, hellaswag/7548, hellaswag/755, hellaswag/7550, hellaswag/7551, hellaswag/7554, hellaswag/7556, hellaswag/7559, hellaswag/756, hellaswag/7560, hellaswag/7561, hellaswag/7562, hellaswag/7563, hellaswag/7564, hellaswag/7568, hellaswag/7570, hellaswag/7572, hellaswag/7574, hellaswag/7577, hellaswag/7578, hellaswag/7580, hellaswag/7581, hellaswag/7583, hellaswag/7584, hellaswag/7587, hellaswag/7588, hellaswag/759, hellaswag/7590, hellaswag/7591, hellaswag/7592, hellaswag/7593, hellaswag/7594, hellaswag/7595, hellaswag/7596, hellaswag/7598, hellaswag/7599, hellaswag/760, hellaswag/7600, hellaswag/7601, hellaswag/7604, hellaswag/7605, hellaswag/7608, hellaswag/7609, hellaswag/761, hellaswag/7610, hellaswag/7612, hellaswag/7615, hellaswag/762, hellaswag/7621, hellaswag/7623, hellaswag/7624, hellaswag/7625, hellaswag/7627, hellaswag/7628, hellaswag/7629, hellaswag/763, hellaswag/7632, hellaswag/7634, hellaswag/7636, hellaswag/7637, hellaswag/7638, hellaswag/7639, hellaswag/764, hellaswag/7647, hellaswag/7649, hellaswag/7651, hellaswag/7653, hellaswag/7654, hellaswag/7655, hellaswag/7656, hellaswag/7658, hellaswag/766, hellaswag/7660, hellaswag/7661, hellaswag/7662, hellaswag/7667, hellaswag/7668, hellaswag/7669, hellaswag/7670, hellaswag/7674, hellaswag/7679, hellaswag/768, hellaswag/7682, hellaswag/7693, hellaswag/7695, hellaswag/7696, hellaswag/7697, hellaswag/7698, hellaswag/7699, hellaswag/7701, hellaswag/7702, hellaswag/7703, hellaswag/7704, hellaswag/7709, hellaswag/7711, hellaswag/7712, hellaswag/7714, hellaswag/7715, hellaswag/7719, hellaswag/7721, hellaswag/7722, hellaswag/7723, hellaswag/7725, hellaswag/7727, hellaswag/7728, hellaswag/7729, hellaswag/7731, hellaswag/7732, hellaswag/7734, hellaswag/7736, hellaswag/7737, hellaswag/774, hellaswag/7740, hellaswag/7744, hellaswag/7745, hellaswag/7749, hellaswag/7754, hellaswag/7755, hellaswag/7756, hellaswag/7757, hellaswag/7758, hellaswag/7759, hellaswag/7760, hellaswag/7762, hellaswag/7763, hellaswag/7766, hellaswag/7767, hellaswag/7768, hellaswag/777, hellaswag/7774, hellaswag/7775, hellaswag/7776, hellaswag/7778, hellaswag/778, hellaswag/7781, hellaswag/7785, hellaswag/7790, hellaswag/7793, hellaswag/7799, hellaswag/7801, hellaswag/7805, hellaswag/7807, hellaswag/7809, hellaswag/7810, hellaswag/7812, hellaswag/7813, hellaswag/7814, hellaswag/7815, hellaswag/7816, hellaswag/7817, hellaswag/7818, hellaswag/7822, hellaswag/7823, hellaswag/7824, hellaswag/7825, hellaswag/7827, hellaswag/7828, hellaswag/783, hellaswag/7833, hellaswag/7835, hellaswag/7837, hellaswag/7838, hellaswag/7842, hellaswag/7844, hellaswag/7846, hellaswag/7847, hellaswag/785, hellaswag/7852, hellaswag/7853, hellaswag/7854, hellaswag/7855, hellaswag/7860, hellaswag/7861, hellaswag/7862, hellaswag/7863, hellaswag/7864, hellaswag/7865, hellaswag/7866, hellaswag/7868, hellaswag/7869, hellaswag/7874, hellaswag/7875, hellaswag/7876, hellaswag/7877, hellaswag/7882, hellaswag/7884, hellaswag/7885, hellaswag/7887, hellaswag/7888, hellaswag/789, hellaswag/7892, hellaswag/7894, hellaswag/7896, hellaswag/7900, hellaswag/7902, hellaswag/7903, hellaswag/7907, hellaswag/7910, hellaswag/7911, hellaswag/7912, hellaswag/7914, hellaswag/7915, hellaswag/7916, hellaswag/7917, hellaswag/7919, hellaswag/7922, hellaswag/7923, hellaswag/7926, hellaswag/7928, hellaswag/7930, hellaswag/7931, hellaswag/7932, hellaswag/7935, hellaswag/7936, hellaswag/7937, hellaswag/7939, hellaswag/7942, hellaswag/7943, hellaswag/7944, hellaswag/7946, hellaswag/7947, hellaswag/7950, hellaswag/7953, hellaswag/7954, hellaswag/7955, hellaswag/7956, hellaswag/7960, hellaswag/7962, hellaswag/7965, hellaswag/7968, hellaswag/7969, hellaswag/797, hellaswag/7970, hellaswag/7971, hellaswag/7972, hellaswag/7976, hellaswag/7977, hellaswag/7979, hellaswag/798, hellaswag/7981, hellaswag/7982, hellaswag/7983, hellaswag/7984, hellaswag/7989, hellaswag/799, hellaswag/7990, hellaswag/7991, hellaswag/7995, hellaswag/7996, hellaswag/7997, hellaswag/7999, hellaswag/80, hellaswag/800, hellaswag/8000, hellaswag/8001, hellaswag/8003, hellaswag/8004, hellaswag/8005, hellaswag/8007, hellaswag/8008, hellaswag/8009, hellaswag/8010, hellaswag/8013, hellaswag/8014, hellaswag/8015, hellaswag/8020, hellaswag/8026, hellaswag/8027, hellaswag/8028, hellaswag/803, hellaswag/8030, hellaswag/8033, hellaswag/8034, hellaswag/8035, hellaswag/8038, hellaswag/8040, hellaswag/8041, hellaswag/8043, hellaswag/8046, hellaswag/8048, hellaswag/8050, hellaswag/8052, hellaswag/8059, hellaswag/806, hellaswag/8062, hellaswag/8063, hellaswag/8064, hellaswag/8068, hellaswag/807, hellaswag/8070, hellaswag/8072, hellaswag/8073, hellaswag/8075, hellaswag/8076, hellaswag/8077, hellaswag/8078, hellaswag/8081, hellaswag/8082, hellaswag/8083, hellaswag/8086, hellaswag/809, hellaswag/8090, hellaswag/8092, hellaswag/8093, hellaswag/8094, hellaswag/8095, hellaswag/8096, hellaswag/8098, hellaswag/8099, hellaswag/810, hellaswag/8102, hellaswag/8105, hellaswag/8106, hellaswag/811, hellaswag/8111, hellaswag/8115, hellaswag/8117, hellaswag/8118, hellaswag/8121, hellaswag/8124, hellaswag/8126, hellaswag/8127, hellaswag/8129, hellaswag/8132, hellaswag/8133, hellaswag/8134, hellaswag/8136, hellaswag/8137, hellaswag/8138, hellaswag/8139, hellaswag/814, hellaswag/8140, hellaswag/8143, hellaswag/8144, hellaswag/8145, hellaswag/8147, hellaswag/8148, hellaswag/8149, hellaswag/815, hellaswag/8152, hellaswag/8153, hellaswag/8155, hellaswag/816, hellaswag/8160, hellaswag/8161, hellaswag/8162, hellaswag/8164, hellaswag/8165, hellaswag/8166, hellaswag/8167, hellaswag/8168, hellaswag/8169, hellaswag/8170, hellaswag/8171, hellaswag/8172, hellaswag/8173, hellaswag/8174, hellaswag/8176, hellaswag/8178, hellaswag/818, hellaswag/8181, hellaswag/8183, hellaswag/8186, hellaswag/8188, hellaswag/8190, hellaswag/8195, hellaswag/8196, hellaswag/8197, hellaswag/820, hellaswag/8202, hellaswag/8204, hellaswag/8205, hellaswag/8209, hellaswag/821, hellaswag/8213, hellaswag/8214, hellaswag/8218, hellaswag/822, hellaswag/8220, hellaswag/8221, hellaswag/8222, hellaswag/8225, hellaswag/8226, hellaswag/8227, hellaswag/8228, hellaswag/8230, hellaswag/8231, hellaswag/8232, hellaswag/8235, hellaswag/8236, hellaswag/8241, hellaswag/8245, hellaswag/8246, hellaswag/8248, hellaswag/8249, hellaswag/8250, hellaswag/8251, hellaswag/8252, hellaswag/8253, hellaswag/8254, hellaswag/8256, hellaswag/8257, hellaswag/826, hellaswag/8263, hellaswag/8265, hellaswag/8268, hellaswag/8269, hellaswag/8271, hellaswag/8272, hellaswag/8274, hellaswag/8278, hellaswag/8279, hellaswag/828, hellaswag/8281, hellaswag/8282, hellaswag/8284, hellaswag/8285, hellaswag/8289, hellaswag/8290, hellaswag/8291, hellaswag/8293, hellaswag/8294, hellaswag/8296, hellaswag/8298, hellaswag/83, hellaswag/8300, hellaswag/8304, hellaswag/8306, hellaswag/8308, hellaswag/8309, hellaswag/8311, hellaswag/8312, hellaswag/8315, hellaswag/8317, hellaswag/8319, hellaswag/8320, hellaswag/8322, hellaswag/8324, hellaswag/8327, hellaswag/8329, hellaswag/833, hellaswag/8330, hellaswag/8336, hellaswag/8339, hellaswag/8340, hellaswag/8341, hellaswag/8342, hellaswag/8345, hellaswag/8347, hellaswag/8348, hellaswag/8349, hellaswag/8350, hellaswag/8352, hellaswag/8353, hellaswag/8354, hellaswag/8358, hellaswag/8359, hellaswag/836, hellaswag/8360, hellaswag/8361, hellaswag/8363, hellaswag/8364, hellaswag/8365, hellaswag/8366, hellaswag/8368, hellaswag/8369, hellaswag/8370, hellaswag/8372, hellaswag/8373, hellaswag/8376, hellaswag/8379, hellaswag/8382, hellaswag/8383, hellaswag/8385, hellaswag/8389, hellaswag/839, hellaswag/8393, hellaswag/8394, hellaswag/8395, hellaswag/8397, hellaswag/8398, hellaswag/840, hellaswag/8400, hellaswag/8401, hellaswag/8405, hellaswag/8408, hellaswag/8409, hellaswag/8411, hellaswag/8412, hellaswag/8413, hellaswag/8416, hellaswag/8419, hellaswag/8421, hellaswag/8422, hellaswag/8423, hellaswag/8424, hellaswag/8428, hellaswag/8430, hellaswag/8435, hellaswag/8436, hellaswag/8437, hellaswag/8438, hellaswag/844, hellaswag/8441, hellaswag/8442, hellaswag/8443, hellaswag/8444, hellaswag/8448, hellaswag/845, hellaswag/8450, hellaswag/8451, hellaswag/8452, hellaswag/8454, hellaswag/8456, hellaswag/8462, hellaswag/8463, hellaswag/8464, hellaswag/8465, hellaswag/8467, hellaswag/8468, hellaswag/8470, hellaswag/8473, hellaswag/8475, hellaswag/8476, hellaswag/8477, hellaswag/8478, hellaswag/8480, hellaswag/8482, hellaswag/8484, hellaswag/8485, hellaswag/8486, hellaswag/8487, hellaswag/8490, hellaswag/8491, hellaswag/8492, hellaswag/8494, hellaswag/8496, hellaswag/8499, hellaswag/8500, hellaswag/8501, hellaswag/8502, hellaswag/8503, hellaswag/8504, hellaswag/8506, hellaswag/8507, hellaswag/8509, hellaswag/8510, hellaswag/8511, hellaswag/8512, hellaswag/8513, hellaswag/8514, hellaswag/8515, hellaswag/8517, hellaswag/8518, hellaswag/852, hellaswag/8520, hellaswag/8522, hellaswag/8523, hellaswag/8524, hellaswag/8526, hellaswag/8529, hellaswag/853, hellaswag/8531, hellaswag/8532, hellaswag/8533, hellaswag/8538, hellaswag/8539, hellaswag/854, hellaswag/8540, hellaswag/8544, hellaswag/8550, hellaswag/8551, hellaswag/8552, hellaswag/8555, hellaswag/8556, hellaswag/8558, hellaswag/8559, hellaswag/8560, hellaswag/8561, hellaswag/8563, hellaswag/8564, hellaswag/8568, hellaswag/8569, hellaswag/857, hellaswag/8571, hellaswag/8573, hellaswag/8574, hellaswag/8575, hellaswag/8577, hellaswag/8578, hellaswag/8579, hellaswag/8582, hellaswag/8583, hellaswag/8585, hellaswag/8587, hellaswag/8588, hellaswag/859, hellaswag/8591, hellaswag/8593, hellaswag/8594, hellaswag/8597, hellaswag/8598, hellaswag/8601, hellaswag/8603, hellaswag/8606, hellaswag/8607, hellaswag/861, hellaswag/8611, hellaswag/8612, hellaswag/8613, hellaswag/8615, hellaswag/8616, hellaswag/8618, hellaswag/8619, hellaswag/862, hellaswag/8620, hellaswag/8621, hellaswag/8623, hellaswag/8625, hellaswag/8626, hellaswag/8629, hellaswag/8631, hellaswag/8632, hellaswag/8633, hellaswag/8634, hellaswag/8635, hellaswag/8636, hellaswag/8640, hellaswag/8641, hellaswag/8642, hellaswag/8643, hellaswag/8645, hellaswag/8647, hellaswag/8648, hellaswag/8649, hellaswag/8650, hellaswag/8651, hellaswag/8653, hellaswag/8654, hellaswag/8657, hellaswag/8658, hellaswag/8663, hellaswag/8664, hellaswag/8666, hellaswag/8667, hellaswag/8668, hellaswag/867, hellaswag/8670, hellaswag/8671, hellaswag/8672, hellaswag/8675, hellaswag/8679, hellaswag/868, hellaswag/8680, hellaswag/8681, hellaswag/8682, hellaswag/8684, hellaswag/8688, hellaswag/8689, hellaswag/869, hellaswag/8690, hellaswag/8691, hellaswag/8692, hellaswag/8693, hellaswag/8694, hellaswag/8695, hellaswag/8697, hellaswag/8698, hellaswag/87, hellaswag/8700, hellaswag/8701, hellaswag/8702, hellaswag/8703, hellaswag/8704, hellaswag/8705, hellaswag/8708, hellaswag/8709, hellaswag/871, hellaswag/8710, hellaswag/8712, hellaswag/8713, hellaswag/8714, hellaswag/8715, hellaswag/8718, hellaswag/8719, hellaswag/872, hellaswag/8720, hellaswag/8721, hellaswag/8724, hellaswag/8725, hellaswag/8727, hellaswag/8728, hellaswag/8734, hellaswag/8737, hellaswag/8738, hellaswag/874, hellaswag/8742, hellaswag/8744, hellaswag/8745, hellaswag/8746, hellaswag/8747, hellaswag/8749, hellaswag/875, hellaswag/8750, hellaswag/8752, hellaswag/8756, hellaswag/876, hellaswag/8760, hellaswag/8762, hellaswag/8763, hellaswag/8764, hellaswag/8766, hellaswag/8767, hellaswag/8768, hellaswag/8769, hellaswag/8773, hellaswag/8775, hellaswag/8780, hellaswag/8781, hellaswag/8782, hellaswag/8784, hellaswag/8785, hellaswag/8787, hellaswag/8788, hellaswag/8789, hellaswag/879, hellaswag/8797, hellaswag/8801, hellaswag/8803, hellaswag/8804, hellaswag/8805, hellaswag/8806, hellaswag/8808, hellaswag/8809, hellaswag/8811, hellaswag/8812, hellaswag/8813, hellaswag/8815, hellaswag/8816, hellaswag/8817, hellaswag/8819, hellaswag/882, hellaswag/8821, hellaswag/8822, hellaswag/8824, hellaswag/8826, hellaswag/8829, hellaswag/883, hellaswag/8830, hellaswag/8833, hellaswag/8835, hellaswag/8836, hellaswag/8837, hellaswag/8838, hellaswag/884, hellaswag/8840, hellaswag/8842, hellaswag/8843, hellaswag/8844, hellaswag/8845, hellaswag/8846, hellaswag/8848, hellaswag/8849, hellaswag/885, hellaswag/8850, hellaswag/8855, hellaswag/8857, hellaswag/886, hellaswag/8860, hellaswag/8864, hellaswag/8869, hellaswag/8870, hellaswag/8871, hellaswag/8873, hellaswag/8874, hellaswag/8877, hellaswag/8878, hellaswag/8879, hellaswag/8881, hellaswag/8888, hellaswag/8890, hellaswag/8891, hellaswag/8893, hellaswag/8894, hellaswag/8895, hellaswag/8896, hellaswag/8898, hellaswag/8899, hellaswag/8900, hellaswag/8901, hellaswag/8902, hellaswag/8905, hellaswag/8914, hellaswag/8916, hellaswag/8917, hellaswag/8918, hellaswag/8919, hellaswag/892, hellaswag/8922, hellaswag/8923, hellaswag/8924, hellaswag/8925, hellaswag/8926, hellaswag/8927, hellaswag/8928, hellaswag/8930, hellaswag/8934, hellaswag/8939, hellaswag/8940, hellaswag/8941, hellaswag/8942, hellaswag/8943, hellaswag/8944, hellaswag/8947, hellaswag/895, hellaswag/8950, hellaswag/8951, hellaswag/8952, hellaswag/8953, hellaswag/8956, hellaswag/8957, hellaswag/8958, hellaswag/8967, hellaswag/897, hellaswag/8970, hellaswag/8971, hellaswag/8973, hellaswag/8974, hellaswag/8975, hellaswag/8976, hellaswag/8978, hellaswag/8980, hellaswag/8981, hellaswag/8985, hellaswag/8986, hellaswag/899, hellaswag/8990, hellaswag/8994, hellaswag/8995, hellaswag/8997, hellaswag/8999, hellaswag/9, hellaswag/90, hellaswag/9001, hellaswag/9002, hellaswag/9003, hellaswag/9006, hellaswag/9007, hellaswag/9009, hellaswag/9010, hellaswag/9012, hellaswag/9016, hellaswag/9019, hellaswag/902, hellaswag/9022, hellaswag/9024, hellaswag/9025, hellaswag/9026, hellaswag/9028, hellaswag/9029, hellaswag/9032, hellaswag/9033, hellaswag/9034, hellaswag/9035, hellaswag/9036, hellaswag/904, hellaswag/9040, hellaswag/9044, hellaswag/9046, hellaswag/9048, hellaswag/9051, hellaswag/9052, hellaswag/9054, hellaswag/9056, hellaswag/9057, hellaswag/9058, hellaswag/9059, hellaswag/9060, hellaswag/9061, hellaswag/9065, hellaswag/9066, hellaswag/9067, hellaswag/9068, hellaswag/9069, hellaswag/907, hellaswag/9071, hellaswag/9072, hellaswag/9073, hellaswag/9074, hellaswag/9075, hellaswag/9078, hellaswag/9080, hellaswag/9081, hellaswag/9088, hellaswag/9091, hellaswag/9094, hellaswag/9096, hellaswag/9097, hellaswag/9101, hellaswag/9103, hellaswag/9105, hellaswag/9108, hellaswag/9110, hellaswag/9112, hellaswag/9113, hellaswag/9116, hellaswag/9118, hellaswag/912, hellaswag/9121, hellaswag/9122, hellaswag/9123, hellaswag/9124, hellaswag/9126, hellaswag/9128, hellaswag/9129, hellaswag/913, hellaswag/9130, hellaswag/9131, hellaswag/9132, hellaswag/9134, hellaswag/9135, hellaswag/9136, hellaswag/9137, hellaswag/914, hellaswag/9141, hellaswag/9143, hellaswag/9144, hellaswag/9147, hellaswag/9148, hellaswag/915, hellaswag/9150, hellaswag/9151, hellaswag/9153, hellaswag/9157, hellaswag/9158, hellaswag/9159, hellaswag/916, hellaswag/9160, hellaswag/9166, hellaswag/9167, hellaswag/917, hellaswag/9170, hellaswag/9171, hellaswag/9172, hellaswag/9173, hellaswag/9174, hellaswag/9178, hellaswag/9179, hellaswag/9182, hellaswag/9185, hellaswag/9187, hellaswag/9191, hellaswag/9195, hellaswag/9198, hellaswag/9200, hellaswag/9202, hellaswag/9204, hellaswag/9207, hellaswag/9208, hellaswag/9209, hellaswag/921, hellaswag/9211, hellaswag/9212, hellaswag/9214, hellaswag/9215, hellaswag/9216, hellaswag/9217, hellaswag/9218, hellaswag/922, hellaswag/9220, hellaswag/9222, hellaswag/9223, hellaswag/9225, hellaswag/9226, hellaswag/9228, hellaswag/9229, hellaswag/923, hellaswag/9233, hellaswag/9234, hellaswag/9236, hellaswag/9239, hellaswag/9240, hellaswag/9241, hellaswag/9245, hellaswag/9249, hellaswag/9250, hellaswag/9252, hellaswag/9254, hellaswag/9257, hellaswag/9258, hellaswag/9259, hellaswag/9264, hellaswag/9265, hellaswag/9267, hellaswag/9268, hellaswag/927, hellaswag/9271, hellaswag/9274, hellaswag/9275, hellaswag/9277, hellaswag/9278, hellaswag/9279, hellaswag/928, hellaswag/9280, hellaswag/9281, hellaswag/9282, hellaswag/9283, hellaswag/9284, hellaswag/9286, hellaswag/9287, hellaswag/9288, hellaswag/9295, hellaswag/9298, hellaswag/930, hellaswag/9300, hellaswag/9303, hellaswag/9306, hellaswag/9309, hellaswag/9311, hellaswag/9312, hellaswag/9313, hellaswag/9317, hellaswag/9318, hellaswag/9319, hellaswag/9323, hellaswag/9326, hellaswag/9327, hellaswag/9329, hellaswag/9330, hellaswag/9331, hellaswag/9332, hellaswag/9334, hellaswag/9337, hellaswag/9339, hellaswag/9340, hellaswag/9344, hellaswag/9345, hellaswag/9347, hellaswag/9348, hellaswag/935, hellaswag/9351, hellaswag/9352, hellaswag/9353, hellaswag/9354, hellaswag/9356, hellaswag/9359, hellaswag/9361, hellaswag/9362, hellaswag/9364, hellaswag/9365, hellaswag/9367, hellaswag/9368, hellaswag/9369, hellaswag/9370, hellaswag/9371, hellaswag/9372, hellaswag/9375, hellaswag/9376, hellaswag/9377, hellaswag/9378, hellaswag/9379, hellaswag/938, hellaswag/9380, hellaswag/9382, hellaswag/9383, hellaswag/9390, hellaswag/9391, hellaswag/9395, hellaswag/9400, hellaswag/9401, hellaswag/9402, hellaswag/9403, hellaswag/9404, hellaswag/9405, hellaswag/9407, hellaswag/9409, hellaswag/941, hellaswag/9410, hellaswag/9411, hellaswag/9412, hellaswag/9413, hellaswag/9416, hellaswag/942, hellaswag/9420, hellaswag/9422, hellaswag/9423, hellaswag/9425, hellaswag/9427, hellaswag/943, hellaswag/9430, hellaswag/9432, hellaswag/9433, hellaswag/9435, hellaswag/9436, hellaswag/9437, hellaswag/9438, hellaswag/9440, hellaswag/9441, hellaswag/9442, hellaswag/9443, hellaswag/9444, hellaswag/9448, hellaswag/9449, hellaswag/945, hellaswag/9451, hellaswag/9455, hellaswag/9459, hellaswag/9460, hellaswag/9461, hellaswag/9462, hellaswag/9465, hellaswag/9467, hellaswag/9469, hellaswag/9470, hellaswag/9472, hellaswag/9474, hellaswag/9475, hellaswag/9477, hellaswag/9478, hellaswag/948, hellaswag/9481, hellaswag/9482, hellaswag/9487, hellaswag/949, hellaswag/9491, hellaswag/9492, hellaswag/9493, hellaswag/9495, hellaswag/9498, hellaswag/9499, hellaswag/9502, hellaswag/9503, hellaswag/9505, hellaswag/9508, hellaswag/951, hellaswag/9510, hellaswag/9512, hellaswag/9513, hellaswag/9515, hellaswag/9517, hellaswag/952, hellaswag/9520, hellaswag/9521, hellaswag/9522, hellaswag/9523, hellaswag/9524, hellaswag/9525, hellaswag/9527, hellaswag/953, hellaswag/9536, hellaswag/9538, hellaswag/9539, hellaswag/9540, hellaswag/9541, hellaswag/9543, hellaswag/9544, hellaswag/9547, hellaswag/9551, hellaswag/9554, hellaswag/9556, hellaswag/9558, hellaswag/9559, hellaswag/9562, hellaswag/9564, hellaswag/9566, hellaswag/9567, hellaswag/9572, hellaswag/9574, hellaswag/9576, hellaswag/9577, hellaswag/9578, hellaswag/9580, hellaswag/9581, hellaswag/9583, hellaswag/9587, hellaswag/9589, hellaswag/959, hellaswag/9590, hellaswag/9593, hellaswag/9596, hellaswag/9597, hellaswag/9598, hellaswag/9599, hellaswag/96, hellaswag/9600, hellaswag/9603, hellaswag/9607, hellaswag/9608, hellaswag/9611, hellaswag/9614, hellaswag/9615, hellaswag/9616, hellaswag/9617, hellaswag/9618, hellaswag/9619, hellaswag/962, hellaswag/9621, hellaswag/9622, hellaswag/9626, hellaswag/9627, hellaswag/9629, hellaswag/963, hellaswag/9630, hellaswag/9631, hellaswag/9633, hellaswag/9636, hellaswag/9637, hellaswag/9638, hellaswag/9642, hellaswag/9644, hellaswag/9646, hellaswag/9647, hellaswag/965, hellaswag/9650, hellaswag/9653, hellaswag/9655, hellaswag/9657, hellaswag/9662, hellaswag/9663, hellaswag/9664, hellaswag/9666, hellaswag/9668, hellaswag/9669, hellaswag/967, hellaswag/9671, hellaswag/9672, hellaswag/9673, hellaswag/9675, hellaswag/9679, hellaswag/968, hellaswag/9680, hellaswag/9681, hellaswag/9682, hellaswag/9683, hellaswag/9684, hellaswag/9688, hellaswag/969, hellaswag/9690, hellaswag/9692, hellaswag/9694, hellaswag/9695, hellaswag/9696, hellaswag/9697, hellaswag/9698, hellaswag/9699, hellaswag/970, hellaswag/9702, hellaswag/9704, hellaswag/9705, hellaswag/9706, hellaswag/9707, hellaswag/9708, hellaswag/9709, hellaswag/971, hellaswag/9710, hellaswag/9711, hellaswag/9714, hellaswag/9716, hellaswag/9718, hellaswag/9719, hellaswag/972, hellaswag/9722, hellaswag/9725, hellaswag/9727, hellaswag/9730, hellaswag/9731, hellaswag/9732, hellaswag/9734, hellaswag/9735, hellaswag/9738, hellaswag/9740, hellaswag/9743, hellaswag/9745, hellaswag/9746, hellaswag/9747, hellaswag/9749, hellaswag/975, hellaswag/9752, hellaswag/9753, hellaswag/9754, hellaswag/9756, hellaswag/9759, hellaswag/976, hellaswag/9760, hellaswag/9762, hellaswag/9763, hellaswag/9765, hellaswag/9768, hellaswag/977, hellaswag/9770, hellaswag/9771, hellaswag/9773, hellaswag/9775, hellaswag/9776, hellaswag/9778, hellaswag/9779, hellaswag/978, hellaswag/9780, hellaswag/9781, hellaswag/9782, hellaswag/9785, hellaswag/9787, hellaswag/9788, hellaswag/9792, hellaswag/9793, hellaswag/9796, hellaswag/9797, hellaswag/9798, hellaswag/9799, hellaswag/98, hellaswag/980, hellaswag/9800, hellaswag/9802, hellaswag/9803, hellaswag/9807, hellaswag/9808, hellaswag/9809, hellaswag/981, hellaswag/9814, hellaswag/9819, hellaswag/982, hellaswag/9820, hellaswag/9823, hellaswag/9825, hellaswag/9827, hellaswag/9828, hellaswag/9831, hellaswag/9833, hellaswag/9834, hellaswag/9835, hellaswag/9837, hellaswag/9838, hellaswag/9842, hellaswag/9844, hellaswag/9846, hellaswag/9847, hellaswag/9849, hellaswag/9853, hellaswag/9855, hellaswag/9858, hellaswag/986, hellaswag/9861, hellaswag/9863, hellaswag/9864, hellaswag/9868, hellaswag/987, hellaswag/9872, hellaswag/9873, hellaswag/9874, hellaswag/9876, hellaswag/9878, hellaswag/9879, hellaswag/9881, hellaswag/9882, hellaswag/9883, hellaswag/9886, hellaswag/9887, hellaswag/9889, hellaswag/9893, hellaswag/9898, hellaswag/9899, hellaswag/990, hellaswag/9900, hellaswag/9902, hellaswag/9904, hellaswag/991, hellaswag/9911, hellaswag/9912, hellaswag/9913, hellaswag/9915, hellaswag/9918, hellaswag/992, hellaswag/9920, hellaswag/9921, hellaswag/9922, hellaswag/9927, hellaswag/9928, hellaswag/993, hellaswag/9931, hellaswag/9932, hellaswag/9933, hellaswag/9938, hellaswag/9939, hellaswag/994, hellaswag/9944, hellaswag/9945, hellaswag/9946, hellaswag/9947, hellaswag/9948, hellaswag/9950, hellaswag/9954, hellaswag/9956, hellaswag/9957, hellaswag/9958, hellaswag/9961, hellaswag/9964, hellaswag/9965, hellaswag/9966, hellaswag/9968, hellaswag/9969, hellaswag/997, hellaswag/9970, hellaswag/9973, hellaswag/9976, hellaswag/998, hellaswag/9982, hellaswag/9983, hellaswag/9985, hellaswag/9987, hellaswag/9989, hellaswag/9992, hellaswag/9996, hellaswag/9997, hellaswag/9999

Problems solved by 1 model only

example_link model min_pass1_of_model
hellaswag/9988 seed6529 0.376
hellaswag/887 seed6529 0.376
hellaswag/8402 seed6529 0.376
hellaswag/2634 seed6529 0.376
hellaswag/264 seed6529 0.376
hellaswag/8596 seed6529 0.376
hellaswag/1765 seed6529 0.376
hellaswag/1838 seed6529 0.376
hellaswag/1989 seed6529 0.376
hellaswag/8854 seed6529 0.376
hellaswag/7681 seed6529 0.376
hellaswag/7537 seed6529 0.376
hellaswag/741 seed6529 0.376
hellaswag/7603 seed6529 0.376
hellaswag/7802 seed6529 0.376
hellaswag/7925 seed6529 0.376
hellaswag/7967 seed6529 0.376
hellaswag/1440 seed6529 0.376
hellaswag/5437 seed6529 0.376
hellaswag/5213 seed6529 0.376
hellaswag/5337 seed6529 0.376
hellaswag/4871 seed6529 0.376
hellaswag/461 seed6529 0.376
hellaswag/1018 seed6529 0.376
hellaswag/9729 seed6529 0.376
hellaswag/9909 seed6529 0.376
hellaswag/1195 seed6529 0.376
hellaswag/1475 seed6529 0.376
hellaswag/1114 seed6529 0.376
hellaswag/5473 seed6529 0.376
hellaswag/6288 seed6529 0.376
hellaswag/5534 seed6529 0.376
hellaswag/5541 seed6529 0.376
hellaswag/5654 seed6529 0.376
hellaswag/6911 seed6529 0.376
hellaswag/7064 seed6529 0.376
hellaswag/6721 seed6529 0.376
hellaswag/6536 seed6529 0.376
hellaswag/7152 seed6529 0.376
hellaswag/7162 seed6529 0.376
hellaswag/2731 seed6529 0.376
hellaswag/7231 seed6529 0.376
hellaswag/7941 seed6529 0.376
hellaswag/8841 seed24762 0.376
hellaswag/9087 seed24762 0.376
hellaswag/9197 seed24762 0.376
hellaswag/9100 seed24762 0.376
hellaswag/894 seed24762 0.376
hellaswag/8913 seed24762 0.376
hellaswag/9246 seed24762 0.376
hellaswag/9488 seed24762 0.376
hellaswag/9485 seed24762 0.376
hellaswag/3586 seed24762 0.376
hellaswag/3496 seed24762 0.376
hellaswag/4648 seed24762 0.376
hellaswag/4761 seed24762 0.376
hellaswag/4689 seed24762 0.376
hellaswag/9757 seed24762 0.376
hellaswag/136 seed24762 0.376
hellaswag/1385 seed24762 0.376
hellaswag/1348 seed24762 0.376
hellaswag/9888 seed24762 0.376
hellaswag/9480 seed24762 0.376
hellaswag/9447 seed24762 0.376
hellaswag/4972 seed24762 0.376
hellaswag/4382 seed24762 0.376
hellaswag/3889 seed24762 0.376
hellaswag/5379 seed24762 0.376
hellaswag/5159 seed24762 0.376
hellaswag/5137 seed24762 0.376
hellaswag/4692 seed24762 0.376
hellaswag/6202 seed24762 0.376
hellaswag/3827 seed24762 0.376
hellaswag/8488 seed24762 0.376
hellaswag/1886 seed24762 0.376
hellaswag/1918 seed24762 0.376
hellaswag/8669 seed24762 0.376
hellaswag/8390 seed24762 0.376
hellaswag/2590 seed24762 0.376
hellaswag/2288 seed24762 0.376
hellaswag/8432 seed24762 0.376
hellaswag/241 seed24762 0.376
hellaswag/8912 seed24762 0.376
hellaswag/2830 seed24762 0.376
hellaswag/6776 seed24762 0.376
hellaswag/4952 seed24762 0.376
hellaswag/4090 seed24762 0.376
hellaswag/8032 seed24762 0.376
hellaswag/7589 seed24762 0.376
hellaswag/5570 seed24762 0.376
hellaswag/289 seed24762 0.376
hellaswag/2985 seed24762 0.376
hellaswag/6885 seed24762 0.376
hellaswag/6269 seed24762 0.376
hellaswag/7791 seed24762 0.376
hellaswag/7643 seed24762 0.376
hellaswag/1443 seed14309 0.374
hellaswag/9582 seed14309 0.374
hellaswag/1000 seed14309 0.374
hellaswag/8998 seed14309 0.374
hellaswag/10015 seed14309 0.374
hellaswag/9145 seed14309 0.374
hellaswag/8834 seed14309 0.374
hellaswag/8740 seed14309 0.374
hellaswag/8198 seed14309 0.374
hellaswag/8276 seed14309 0.374
hellaswag/8537 seed14309 0.374
hellaswag/1915 seed14309 0.374
hellaswag/214 seed14309 0.374
hellaswag/2040 seed14309 0.374
hellaswag/2680 seed14309 0.374
hellaswag/8554 seed14309 0.374
hellaswag/8280 seed14309 0.374
hellaswag/2214 seed14309 0.374
hellaswag/2949 seed14309 0.374
hellaswag/7893 seed14309 0.374
hellaswag/2258 seed14309 0.374
hellaswag/808 seed14309 0.374
hellaswag/7873 seed14309 0.374
hellaswag/7974 seed14309 0.374
hellaswag/2250 seed14309 0.374
hellaswag/1602 seed14309 0.374
hellaswag/5036 seed14309 0.374
hellaswag/5147 seed14309 0.374
hellaswag/3503 seed14309 0.374
hellaswag/5190 seed14309 0.374
hellaswag/9388 seed14309 0.374
hellaswag/9923 seed14309 0.374
hellaswag/1146 seed14309 0.374
hellaswag/1174 seed14309 0.374
hellaswag/3978 seed14309 0.374
hellaswag/6974 seed14309 0.374
hellaswag/7819 seed14309 0.374
hellaswag/649 seed14309 0.374
hellaswag/4062 seed14309 0.374
hellaswag/9721 seed14309 0.374
hellaswag/7010 seed14309 0.374
hellaswag/8158 seed14309 0.374
hellaswag/6217 seed14309 0.374
hellaswag/2582 seed149 0.373
hellaswag/8233 seed149 0.373
hellaswag/8223 seed149 0.373
hellaswag/203 seed149 0.373
hellaswag/900 seed149 0.373
hellaswag/9077 seed149 0.373
hellaswag/2132 seed149 0.373
hellaswag/3739 seed149 0.373
hellaswag/370 seed149 0.373
hellaswag/4071 seed149 0.373
hellaswag/4124 seed149 0.373
hellaswag/5998 seed149 0.373
hellaswag/5897 seed149 0.373
hellaswag/6252 seed149 0.373
hellaswag/6145 seed149 0.373
hellaswag/6561 seed149 0.373
hellaswag/3360 seed149 0.373
hellaswag/3016 seed149 0.373
hellaswag/788 seed149 0.373
hellaswag/7993 seed149 0.373
hellaswag/2961 seed149 0.373
hellaswag/3635 seed149 0.373
hellaswag/5332 seed149 0.373
hellaswag/4483 seed149 0.373
hellaswag/4519 seed149 0.373
hellaswag/4705 seed149 0.373
hellaswag/4649 seed149 0.373
hellaswag/4916 seed149 0.373
hellaswag/4793 seed149 0.373
hellaswag/5080 seed149 0.373
hellaswag/5106 seed149 0.373
hellaswag/9389 seed149 0.373
hellaswag/937 seed149 0.373
hellaswag/9917 seed149 0.373
hellaswag/9774 seed149 0.373
hellaswag/1316 seed149 0.373
hellaswag/1612 seed149 0.373
hellaswag/1606 seed149 0.373
hellaswag/1588 seed149 0.373
hellaswag/1162 seed17495 0.372
hellaswag/1695 seed17495 0.372
hellaswag/1314 seed17495 0.372
hellaswag/93 seed17495 0.372
hellaswag/1759 seed17495 0.372
hellaswag/1286 seed17495 0.372
hellaswag/2635 seed17495 0.372
hellaswag/3648 seed17495 0.372
hellaswag/8371 seed17495 0.372
hellaswag/6155 seed17495 0.372
hellaswag/3614 seed17495 0.372
hellaswag/4247 seed17495 0.372
hellaswag/5830 seed17495 0.372
hellaswag/5899 seed17495 0.372
hellaswag/5711 seed17495 0.372
hellaswag/5796 seed17495 0.372
hellaswag/5530 seed17495 0.372
hellaswag/2535 seed17495 0.372
hellaswag/2644 seed17495 0.372
hellaswag/5410 seed17495 0.372
hellaswag/7213 seed17495 0.372
hellaswag/7270 seed17495 0.372
hellaswag/2426 seed17495 0.372
hellaswag/7671 seed17495 0.372
hellaswag/6662 seed17495 0.372
hellaswag/7733 seed17495 0.372
hellaswag/9291 seed17495 0.372
hellaswag/8753 seed17495 0.372
hellaswag/431 seed17495 0.372
hellaswag/74 seed17495 0.372
hellaswag/7375 seed17495 0.372
hellaswag/2441 seed17495 0.372
hellaswag/2398 seed17495 0.372
hellaswag/9744 seed17495 0.372
hellaswag/9789 seed17495 0.372
hellaswag/4280 seed17495 0.372
hellaswag/2109 seed17495 0.372
hellaswag/4477 seed17495 0.372
hellaswag/4560 seed17495 0.372
hellaswag/1768 seed17495 0.372
hellaswag/946 seed17495 0.372
hellaswag/2403 seed17495 0.372
hellaswag/2445 seed17495 0.372
hellaswag/7557 seed17495 0.372
hellaswag/5178 seed30841 0.371
hellaswag/8460 seed30841 0.371
hellaswag/5596 seed30841 0.371
hellaswag/3992 seed30841 0.371
hellaswag/8259 seed30841 0.371
hellaswag/6099 seed30841 0.371
hellaswag/543 seed30841 0.371
hellaswag/84 seed30841 0.371
hellaswag/3467 seed30841 0.371
hellaswag/8911 seed30841 0.371
hellaswag/9296 seed30841 0.371
hellaswag/8047 seed30841 0.371
hellaswag/8023 seed30841 0.371
hellaswag/6687 seed30841 0.371
hellaswag/2814 seed30841 0.371
hellaswag/6550 seed30841 0.371
hellaswag/7659 seed30841 0.371
hellaswag/2453 seed30841 0.371
hellaswag/3155 seed30841 0.371
hellaswag/3139 seed30841 0.371
hellaswag/7315 seed30841 0.371
hellaswag/1288 seed30841 0.371
hellaswag/6560 seed30841 0.371
hellaswag/3393 seed30841 0.371
hellaswag/1646 seed30841 0.371
hellaswag/6680 seed30841 0.371
hellaswag/8067 seed30841 0.371
hellaswag/7867 seed30841 0.371
hellaswag/7687 seed30841 0.371
hellaswag/2001 seed30841 0.371
hellaswag/2032 seed30841 0.371
hellaswag/448 seed30841 0.371
hellaswag/9896 seed30841 0.371
hellaswag/9373 seed30841 0.371
hellaswag/9490 seed30841 0.371
hellaswag/4448 seed30841 0.371
hellaswag/7780 seed30841 0.371
hellaswag/8979 seed30841 0.371
hellaswag/1126 seed30841 0.371
hellaswag/8525 seed30841 0.371
hellaswag/9357 seed30841 0.371
hellaswag/8614 seed30841 0.371
hellaswag/8203 seed16385 0.370
hellaswag/2695 seed16385 0.370
hellaswag/1723 seed16385 0.370
hellaswag/9468 seed16385 0.370
hellaswag/9936 seed16385 0.370
hellaswag/1899 seed16385 0.370
hellaswag/4610 seed16385 0.370
hellaswag/1829 seed16385 0.370
hellaswag/1858 seed16385 0.370
hellaswag/979 seed16385 0.370
hellaswag/4321 seed16385 0.370
hellaswag/9880 seed16385 0.370
hellaswag/9907 seed16385 0.370
hellaswag/2006 seed16385 0.370
hellaswag/2144 seed16385 0.370
hellaswag/2021 seed16385 0.370
hellaswag/2016 seed16385 0.370
hellaswag/1773 seed16385 0.370
hellaswag/7782 seed16385 0.370
hellaswag/7909 seed16385 0.370
hellaswag/905 seed16385 0.370
hellaswag/9203 seed16385 0.370
hellaswag/8863 seed16385 0.370
hellaswag/8060 seed16385 0.370
hellaswag/7998 seed16385 0.370
hellaswag/7648 seed16385 0.370
hellaswag/7149 seed16385 0.370
hellaswag/640 seed16385 0.370
hellaswag/3036 seed16385 0.370
hellaswag/81 seed16385 0.370
hellaswag/681 seed16385 0.370
hellaswag/2902 seed16385 0.370
hellaswag/2941 seed16385 0.370
hellaswag/6751 seed16385 0.370
hellaswag/6909 seed16385 0.370
hellaswag/5347 seed16385 0.370
hellaswag/5926 seed16385 0.370
hellaswag/5176 seed16385 0.370
hellaswag/8716 seed16385 0.370
hellaswag/758 seed16385 0.370
hellaswag/6469 seed16385 0.370
hellaswag/6156 seed16385 0.370
hellaswag/5616 seed16385 0.370
hellaswag/8659 seed16385 0.370
hellaswag/8660 seed16385 0.370
hellaswag/2654 seed16385 0.370
hellaswag/4816 seed16385 0.370
hellaswag/4964 seed16385 0.370
hellaswag/4117 seed16385 0.370
hellaswag/9995 seed27712 0.367
hellaswag/1039 seed27712 0.367
hellaswag/8562 seed27712 0.367
hellaswag/4150 seed27712 0.367
hellaswag/621 seed27712 0.367
hellaswag/5655 seed27712 0.367
hellaswag/4996 seed27712 0.367
hellaswag/1134 seed27712 0.367
hellaswag/786 seed27712 0.367
hellaswag/2953 seed27712 0.367
hellaswag/7713 seed27712 0.367
hellaswag/6018 seed27712 0.367
hellaswag/5423 seed27712 0.367
hellaswag/8440 seed27712 0.367
hellaswag/3625 seed27712 0.367
hellaswag/2619 seed27712 0.367
hellaswag/366 seed27712 0.367
hellaswag/3834 seed27712 0.367
hellaswag/4403 seed27712 0.367
hellaswag/7924 seed27712 0.367
hellaswag/4317 seed27712 0.367
hellaswag/4644 seed27712 0.367
hellaswag/9106 seed27712 0.367
hellaswag/9165 seed27712 0.367
hellaswag/8723 seed27712 0.367
hellaswag/9242 seed27712 0.367
hellaswag/6957 seed27712 0.367
hellaswag/2201 seed27712 0.367
hellaswag/7455 seed27712 0.367
hellaswag/3469 seed27712 0.367
hellaswag/2696 seed27712 0.367
hellaswag/2863 seed27712 0.367
hellaswag/7836 seed27712 0.367
hellaswag/5035 seed24734 0.367
hellaswag/3761 seed24734 0.367
hellaswag/2534 seed24734 0.367
hellaswag/1072 seed24734 0.367
hellaswag/111 seed24734 0.367
hellaswag/1002 seed24734 0.367
hellaswag/1201 seed24734 0.367
hellaswag/1507 seed24734 0.367
hellaswag/1657 seed24734 0.367
hellaswag/1045 seed24734 0.367
hellaswag/4962 seed24734 0.367
hellaswag/5267 seed24734 0.367
hellaswag/3924 seed24734 0.367
hellaswag/3936 seed24734 0.367
hellaswag/3544 seed24734 0.367
hellaswag/5046 seed24734 0.367
hellaswag/5211 seed24734 0.367
hellaswag/411 seed24734 0.367
hellaswag/5546 seed24734 0.367
hellaswag/5906 seed24734 0.367
hellaswag/4901 seed24734 0.367
hellaswag/6033 seed24734 0.367
hellaswag/6185 seed24734 0.367
hellaswag/6287 seed24734 0.367
hellaswag/5704 seed24734 0.367
hellaswag/2242 seed24734 0.367
hellaswag/2753 seed24734 0.367
hellaswag/280 seed24734 0.367
hellaswag/2736 seed24734 0.367
hellaswag/6968 seed24734 0.367
hellaswag/6502 seed24734 0.367
hellaswag/6503 seed24734 0.367
hellaswag/7640 seed24734 0.367
hellaswag/3123 seed24734 0.367
hellaswag/2160 seed24734 0.367
hellaswag/2468 seed24734 0.367
hellaswag/3340 seed24734 0.367
hellaswag/7450 seed24734 0.367
hellaswag/7243 seed24734 0.367
hellaswag/3124 seed24734 0.367
hellaswag/3190 seed24734 0.367
hellaswag/6590 seed24734 0.367
hellaswag/8755 seed24734 0.367
hellaswag/7841 seed24734 0.367
hellaswag/779 seed24734 0.367
hellaswag/1583 seed24734 0.367
hellaswag/195 seed24734 0.367
hellaswag/9399 seed24734 0.367
hellaswag/9739 seed24734 0.367
hellaswag/9454 seed6115 0.367
hellaswag/9667 seed6115 0.367
hellaswag/9955 seed6115 0.367
hellaswag/4303 seed6115 0.367
hellaswag/4329 seed6115 0.367
hellaswag/4334 seed6115 0.367
hellaswag/4768 seed6115 0.367
hellaswag/4778 seed6115 0.367
hellaswag/1922 seed6115 0.367
hellaswag/1988 seed6115 0.367
hellaswag/2041 seed6115 0.367
hellaswag/2115 seed6115 0.367
hellaswag/9146 seed6115 0.367
hellaswag/7739 seed6115 0.367
hellaswag/7891 seed6115 0.367
hellaswag/2154 seed6115 0.367
hellaswag/2161 seed6115 0.367
hellaswag/2283 seed6115 0.367
hellaswag/2533 seed6115 0.367
hellaswag/3234 seed6115 0.367
hellaswag/7103 seed6115 0.367
hellaswag/7179 seed6115 0.367
hellaswag/7304 seed6115 0.367
hellaswag/7409 seed6115 0.367
hellaswag/7473 seed6115 0.367
hellaswag/7676 seed6115 0.367
hellaswag/6462 seed6115 0.367
hellaswag/6557 seed6115 0.367
hellaswag/2708 seed6115 0.367
hellaswag/2952 seed6115 0.367
hellaswag/2971 seed6115 0.367
hellaswag/3059 seed6115 0.367
hellaswag/4070 seed6115 0.367
hellaswag/4089 seed6115 0.367
hellaswag/4177 seed6115 0.367
hellaswag/4228 seed6115 0.367
hellaswag/5468 seed6115 0.367
hellaswag/5501 seed6115 0.367
hellaswag/5696 seed6115 0.367
hellaswag/6097 seed6115 0.367
hellaswag/4928 seed6115 0.367
hellaswag/4955 seed6115 0.367
hellaswag/5108 seed6115 0.367
hellaswag/5399 seed6115 0.367
hellaswag/544 seed6115 0.367
hellaswag/5463 seed6115 0.367
hellaswag/4000 seed6115 0.367
hellaswag/2673 seed6115 0.367
hellaswag/8357 seed6115 0.367
hellaswag/8377 seed6115 0.367
hellaswag/8547 seed6115 0.367
hellaswag/856 seed6115 0.367
hellaswag/8638 seed6115 0.367
hellaswag/8674 seed6115 0.367
hellaswag/8711 seed6115 0.367
hellaswag/131 seed6115 0.367
hellaswag/9977 seed6115 0.367
hellaswag/1296 seed6115 0.367
hellaswag/1158 seed6115 0.367

Suspect problems

These are 10 problems with the lowest correlation with the overall evaluation (i.e. better models tend to do worse on these. )

example_link pass1_of_ex tau
hellaswag/2020 0.500 -0.745
hellaswag/1896 0.500 -0.745
hellaswag/1380 0.400 -0.730
hellaswag/222 0.700 -0.683
hellaswag/2850 0.700 -0.683
hellaswag/6857 0.300 -0.683
hellaswag/77 0.700 -0.683
hellaswag/3468 0.500 -0.626
hellaswag/1617 0.300 -0.618
hellaswag/6562 0.300 -0.618

Histogram of accuracies

Histogram of problems by the accuracy on each problem.

Histogram of difficulties

Histogram of problems by the minimum win rate to solve each problem.