simpleqa

v1.0

SimpleQA: 4,326 short, fact-seeking questions from OpenAI for evaluating language model factuality. Uses LLM-as-a-judge grading. Source: https://openai.com/index/introducing-simpleqa/

uvx harbor run -d simpleqa@1.0

Tasks (4326)

simpleqa-1178
uvx harbor run -d simpleqa@1.0 -t simpleqa-1178
b8f0fa9
simpleqa-1179
uvx harbor run -d simpleqa@1.0 -t simpleqa-1179
b8f0fa9
simpleqa-118
uvx harbor run -d simpleqa@1.0 -t simpleqa-118
b8f0fa9
simpleqa-1180
uvx harbor run -d simpleqa@1.0 -t simpleqa-1180
b8f0fa9
simpleqa-1181
uvx harbor run -d simpleqa@1.0 -t simpleqa-1181
b8f0fa9
simpleqa-1182
uvx harbor run -d simpleqa@1.0 -t simpleqa-1182
b8f0fa9
simpleqa-1183
uvx harbor run -d simpleqa@1.0 -t simpleqa-1183
b8f0fa9
simpleqa-1184
uvx harbor run -d simpleqa@1.0 -t simpleqa-1184
b8f0fa9
simpleqa-1185
uvx harbor run -d simpleqa@1.0 -t simpleqa-1185
b8f0fa9
simpleqa-1186
uvx harbor run -d simpleqa@1.0 -t simpleqa-1186
b8f0fa9
simpleqa-1187
uvx harbor run -d simpleqa@1.0 -t simpleqa-1187
b8f0fa9
simpleqa-1188
uvx harbor run -d simpleqa@1.0 -t simpleqa-1188
b8f0fa9
simpleqa-1189
uvx harbor run -d simpleqa@1.0 -t simpleqa-1189
b8f0fa9
simpleqa-119
uvx harbor run -d simpleqa@1.0 -t simpleqa-119
b8f0fa9
simpleqa-1190
uvx harbor run -d simpleqa@1.0 -t simpleqa-1190
b8f0fa9
simpleqa-1191
uvx harbor run -d simpleqa@1.0 -t simpleqa-1191
b8f0fa9
simpleqa-1192
uvx harbor run -d simpleqa@1.0 -t simpleqa-1192
b8f0fa9
simpleqa-1193
uvx harbor run -d simpleqa@1.0 -t simpleqa-1193
b8f0fa9
simpleqa-1194
uvx harbor run -d simpleqa@1.0 -t simpleqa-1194
b8f0fa9
simpleqa-1195
uvx harbor run -d simpleqa@1.0 -t simpleqa-1195
b8f0fa9
simpleqa-1196
uvx harbor run -d simpleqa@1.0 -t simpleqa-1196
b8f0fa9
simpleqa-1197
uvx harbor run -d simpleqa@1.0 -t simpleqa-1197
b8f0fa9
simpleqa-1198
uvx harbor run -d simpleqa@1.0 -t simpleqa-1198
b8f0fa9
simpleqa-1199
uvx harbor run -d simpleqa@1.0 -t simpleqa-1199
b8f0fa9
simpleqa-12
uvx harbor run -d simpleqa@1.0 -t simpleqa-12
b8f0fa9
simpleqa-120
uvx harbor run -d simpleqa@1.0 -t simpleqa-120
b8f0fa9
simpleqa-1200
uvx harbor run -d simpleqa@1.0 -t simpleqa-1200
b8f0fa9
simpleqa-1201
uvx harbor run -d simpleqa@1.0 -t simpleqa-1201
b8f0fa9
simpleqa-1202
uvx harbor run -d simpleqa@1.0 -t simpleqa-1202
b8f0fa9
simpleqa-1203
uvx harbor run -d simpleqa@1.0 -t simpleqa-1203
b8f0fa9
simpleqa-1204
uvx harbor run -d simpleqa@1.0 -t simpleqa-1204
b8f0fa9
simpleqa-1205
uvx harbor run -d simpleqa@1.0 -t simpleqa-1205
b8f0fa9
simpleqa-1206
uvx harbor run -d simpleqa@1.0 -t simpleqa-1206
b8f0fa9
simpleqa-1207
uvx harbor run -d simpleqa@1.0 -t simpleqa-1207
b8f0fa9
simpleqa-1208
uvx harbor run -d simpleqa@1.0 -t simpleqa-1208
b8f0fa9
simpleqa-1209
uvx harbor run -d simpleqa@1.0 -t simpleqa-1209
b8f0fa9
simpleqa-121
uvx harbor run -d simpleqa@1.0 -t simpleqa-121
b8f0fa9
simpleqa-1210
uvx harbor run -d simpleqa@1.0 -t simpleqa-1210
b8f0fa9
simpleqa-1211
uvx harbor run -d simpleqa@1.0 -t simpleqa-1211
b8f0fa9
simpleqa-1212
uvx harbor run -d simpleqa@1.0 -t simpleqa-1212
b8f0fa9
simpleqa-1213
uvx harbor run -d simpleqa@1.0 -t simpleqa-1213
b8f0fa9
simpleqa-1214
uvx harbor run -d simpleqa@1.0 -t simpleqa-1214
b8f0fa9
simpleqa-1215
uvx harbor run -d simpleqa@1.0 -t simpleqa-1215
b8f0fa9
simpleqa-1216
uvx harbor run -d simpleqa@1.0 -t simpleqa-1216
b8f0fa9
simpleqa-1217
uvx harbor run -d simpleqa@1.0 -t simpleqa-1217
b8f0fa9
simpleqa-1218
uvx harbor run -d simpleqa@1.0 -t simpleqa-1218
b8f0fa9
simpleqa-1219
uvx harbor run -d simpleqa@1.0 -t simpleqa-1219
b8f0fa9
simpleqa-122
uvx harbor run -d simpleqa@1.0 -t simpleqa-122
b8f0fa9
simpleqa-1220
uvx harbor run -d simpleqa@1.0 -t simpleqa-1220
b8f0fa9
simpleqa-1221
uvx harbor run -d simpleqa@1.0 -t simpleqa-1221
b8f0fa9
simpleqa-1222
uvx harbor run -d simpleqa@1.0 -t simpleqa-1222
b8f0fa9
simpleqa-1223
uvx harbor run -d simpleqa@1.0 -t simpleqa-1223
b8f0fa9
simpleqa-1224
uvx harbor run -d simpleqa@1.0 -t simpleqa-1224
b8f0fa9
simpleqa-1225
uvx harbor run -d simpleqa@1.0 -t simpleqa-1225
b8f0fa9
simpleqa-1226
uvx harbor run -d simpleqa@1.0 -t simpleqa-1226
b8f0fa9
simpleqa-1227
uvx harbor run -d simpleqa@1.0 -t simpleqa-1227
b8f0fa9
simpleqa-1228
uvx harbor run -d simpleqa@1.0 -t simpleqa-1228
b8f0fa9
simpleqa-1229
uvx harbor run -d simpleqa@1.0 -t simpleqa-1229
b8f0fa9
simpleqa-123
uvx harbor run -d simpleqa@1.0 -t simpleqa-123
b8f0fa9
simpleqa-1230
uvx harbor run -d simpleqa@1.0 -t simpleqa-1230
b8f0fa9
simpleqa-1231
uvx harbor run -d simpleqa@1.0 -t simpleqa-1231
b8f0fa9
simpleqa-1232
uvx harbor run -d simpleqa@1.0 -t simpleqa-1232
b8f0fa9
simpleqa-1233
uvx harbor run -d simpleqa@1.0 -t simpleqa-1233
b8f0fa9
simpleqa-1234
uvx harbor run -d simpleqa@1.0 -t simpleqa-1234
b8f0fa9
simpleqa-1235
uvx harbor run -d simpleqa@1.0 -t simpleqa-1235
b8f0fa9
simpleqa-1236
uvx harbor run -d simpleqa@1.0 -t simpleqa-1236
b8f0fa9
simpleqa-1237
uvx harbor run -d simpleqa@1.0 -t simpleqa-1237
b8f0fa9
simpleqa-1238
uvx harbor run -d simpleqa@1.0 -t simpleqa-1238
b8f0fa9
simpleqa-1239
uvx harbor run -d simpleqa@1.0 -t simpleqa-1239
b8f0fa9
simpleqa-124
uvx harbor run -d simpleqa@1.0 -t simpleqa-124
b8f0fa9
simpleqa-1240
uvx harbor run -d simpleqa@1.0 -t simpleqa-1240
b8f0fa9
simpleqa-1241
uvx harbor run -d simpleqa@1.0 -t simpleqa-1241
b8f0fa9
simpleqa-1242
uvx harbor run -d simpleqa@1.0 -t simpleqa-1242
b8f0fa9
simpleqa-1243
uvx harbor run -d simpleqa@1.0 -t simpleqa-1243
b8f0fa9
simpleqa-1244
uvx harbor run -d simpleqa@1.0 -t simpleqa-1244
b8f0fa9
simpleqa-1245
uvx harbor run -d simpleqa@1.0 -t simpleqa-1245
b8f0fa9
simpleqa-1246
uvx harbor run -d simpleqa@1.0 -t simpleqa-1246
b8f0fa9
simpleqa-1247
uvx harbor run -d simpleqa@1.0 -t simpleqa-1247
b8f0fa9
simpleqa-1248
uvx harbor run -d simpleqa@1.0 -t simpleqa-1248
b8f0fa9
simpleqa-1249
uvx harbor run -d simpleqa@1.0 -t simpleqa-1249
b8f0fa9
simpleqa-125
uvx harbor run -d simpleqa@1.0 -t simpleqa-125
b8f0fa9
simpleqa-1250
uvx harbor run -d simpleqa@1.0 -t simpleqa-1250
b8f0fa9
simpleqa-1251
uvx harbor run -d simpleqa@1.0 -t simpleqa-1251
b8f0fa9
simpleqa-1252
uvx harbor run -d simpleqa@1.0 -t simpleqa-1252
b8f0fa9
simpleqa-1253
uvx harbor run -d simpleqa@1.0 -t simpleqa-1253
b8f0fa9
simpleqa-1254
uvx harbor run -d simpleqa@1.0 -t simpleqa-1254
b8f0fa9
simpleqa-1255
uvx harbor run -d simpleqa@1.0 -t simpleqa-1255
b8f0fa9
simpleqa-1256
uvx harbor run -d simpleqa@1.0 -t simpleqa-1256
b8f0fa9
simpleqa-1257
uvx harbor run -d simpleqa@1.0 -t simpleqa-1257
b8f0fa9
simpleqa-1258
uvx harbor run -d simpleqa@1.0 -t simpleqa-1258
b8f0fa9
simpleqa-1259
uvx harbor run -d simpleqa@1.0 -t simpleqa-1259
b8f0fa9
simpleqa-126
uvx harbor run -d simpleqa@1.0 -t simpleqa-126
b8f0fa9
simpleqa-1260
uvx harbor run -d simpleqa@1.0 -t simpleqa-1260
b8f0fa9
simpleqa-1261
uvx harbor run -d simpleqa@1.0 -t simpleqa-1261
b8f0fa9
simpleqa-1262
uvx harbor run -d simpleqa@1.0 -t simpleqa-1262
b8f0fa9
simpleqa-1263
uvx harbor run -d simpleqa@1.0 -t simpleqa-1263
b8f0fa9
simpleqa-1264
uvx harbor run -d simpleqa@1.0 -t simpleqa-1264
b8f0fa9
simpleqa-1265
uvx harbor run -d simpleqa@1.0 -t simpleqa-1265
b8f0fa9
simpleqa-1266
uvx harbor run -d simpleqa@1.0 -t simpleqa-1266
b8f0fa9
simpleqa-1267
uvx harbor run -d simpleqa@1.0 -t simpleqa-1267
b8f0fa9