基准来源 · 固定版本证据
WebArena
围绕购物、讨论、代码托管和地图等基准网站副本的浏览器任务。
812固定定义
0参数化模板
812附验证器引用的记录
0本次收集中已运行
环境与统计范围
固定任务实例保留模板 ID 与参数。基准站点标签不代表接入同名商业服务;未镜像网站数据库。
如何判定任务结果?
按固定来源版本保留原始评价配置及共享的浏览器评估实现。
保留源码不代表已验证评分准确性或端到端可复现性。
来源版本 dce04686a56253aefba7b18a4fa0937cf1dc987b
上游许可: Apache-2.0 · 平台: Web
来源分类
以下为上游或导入器标签;这些记录尚未映射到分类树的 430 个任务小类。
gitlab 180gitlab+reddit 10gitlab+wikipedia 6map 109map+shopping_admin 2map+wikipedia 1reddit 106reddit+gitlab 8shopping 187shopping+reddit 5shopping_admin 182wikipedia+map 16
逐条查看已收集定义
展开记录即可查看原始指令和验证器链接。任务正文保留英文;全文筛选请使用上方交互浏览入口。
0What is the top-1 best-selling product in 2022
1What is the top-1 best-selling brand in Quarter 1 2022
2What is the top-1 best-selling product type in Quarter 1 2022
3What are the top-2 best-selling product in 2022
4What are the top-3 best-selling product in Jan 2023
5What is the top-1 best-selling product type in Jan 2023
6What are the top-5 best-selling product in 2023
7Tell me the full address of all international airports that are within a driving distance of 50 km to Carnegie Mellon Univers…
8Tell me the full address of all international airports that are within a driving distance of 5 km to Carnegie Mellon Universi…
9Tell me the full address of all international airports that are within a driving distance of 30 km to Carnegie Art Museum
10Tell me the full address of all US international airports that are within a driving distance of 60 km to Niagara Falls
11Tell me the the number of reviews that our store received by far that mention term "disappointed"
12Tell me the the number of reviews that our store received by far that mention term "satisfied"
13Tell me the the number of reviews that our store received by far that mention term "decent"
14Tell me the the number of reviews that our store received by far that mention term "not useful"
15Tell me the the number of reviews that our store received by far that mention term "best"
16Compare the time for walking and driving route from 5000 Fifth Avenue, Pittsburgh to UPMC family health center
17Compare the time for walking and driving route from AMC Waterfront to Carnegie Mellon University
18Compare the time for walking and driving route from AMC Waterfront to Univ of Pittsburgh
19Compare the time for walking and driving route from Carnegie Science Center to Carnegie Mellon University
20Compare the difference in time for walking and driving route from Randyland to Carnegie Mellon University
21List out reviewers, if exist, who mention about ear cups being small
22List out reviewers, if exist, who mention about under water photo
23List out reviewers, if exist, who mention about good fingerprint resistant
24List out reviewers, if exist, who mention about price being unfair
25List out reviewers, if exist, who mention about average print quality
26List out reviewers, if exist, who mention about complain of the customer service
27Tell me the count of comments that have received more downvotes than upvotes for the user who made the latest post on the Sho…
28Tell me the count of comments that have received more downvotes than upvotes for the user who made the latest post on the Wor…
29Tell me the count of comments that have received more downvotes than upvotes for the user who made the latest post on the DIY…
30Tell me the count of comments that have received more downvotes than upvotes for the user who made the latest post on the spa…
31Tell me the count of comments that have received more downvotes than upvotes for the user who made the latest post on the pho…
32I will arrive Pittsburgh Airport soon. Provide the name of a Hilton hotel in the vicinity, if available. Then, tell me the th…
33I will arrive Pittsburgh Airport soon. Provide the name of a Hilton hotel in the vicinity, if available. Then, tell me the th…
34I will arrive Pittsburgh Airport soon. Provide the name of a Hyatt hotel in the vicinity, if available. Then, tell me the the…
35I will arrive Pittsburgh Airport soon. Provide the name of a Hyatt hotel in the vicinity, if available. Then, tell me the the…
36Check if the social security administration in pittsburgh can be reached in one hour by car from Carnegie Mellon University
37Check if the police station in pittsburgh can be reached in one hour by car from gates building at CMU
38Check if the duquesne university in pittsburgh can be reached in one hour by car from pittsburgh airport
39Check if the walmart in pittsburgh can be reached in one hour by car from 5600 fifth avenue
40Check if the amc theatre in pittsburgh can be reached in one hour by car from hobart street
47Today is 6/12/2023. Tell me how many fulfilled orders I have over the past month, and the total amount of money I spent.
48Today is 6/12/2023. Tell me how many fulfilled orders I have over the past three days, and the total amount of money I spent.
49Today is 6/12/2023. Tell me how many fulfilled orders I have over the past four month, and the total amount of money I spent.
50Today is 6/12/2023. Tell me how many fulfilled orders I have over the past year, and the total amount of money I spent.
51Today is 6/12/2023. Tell me how many fulfilled orders I have over the past six month, and the total amount of money I spent.
52How long does it take to walk from Carnegie Mellon University to starbucks on Craig Street?
53How long does it take to walk from Univ of Pittsburgh to starbucks on Craig Street?
54How long does it take to walk from Carnegie Mellon University to Univ of Pittsburgh?
55How long does it take to walk from the starbuck near CMU to Chatham university?
56How long does it take to walk from Carnegie Museum of Art to a library at CMU?
57Tell me the closest restaurant(s) to university center at Carnegie Mellon University
58Tell me the closest cafe(s) to CMU Hunt library
59Tell me the closest restaurant(s) to CMU Hunt library
60Tell me the closest restaurant(s) to CMU Posner Hall
61Tell me the closest restaurant(s) to CMU Sorrells Library
62Which customer has completed the most number of orders in the entire history?
63Which customer(s) has completed the second most number of orders in the entire history?
64Which customer has placed 2 orders in the entire history?
65Which customer has completed the fifth most number of orders in the entire history?
66Among the top 10 post in "books" forum, show me the post URLs that recommand a single book
67Among the top 10 post in "books" forum, show me the book names from posts that recommand a single book
68Among the top 10 post in "books" forum, show me the author name and the book name from posts that recommand a single book
69Among the top 10 post in "books" forum, is there any post talks about supporting local book stores? If so, tell me the organi…
70What is the zip code of Carnegie Mellon University?
71What is the zip code of Chatham University?
73What is the zip code of Columbia University?
74Given the following locations, ['Carnegie Mellon University', 'apple store shadyside', 'starbucks on craig street'], what wou…
75Given the following locations, ['Massachusetts Institute of Technology', 'Harvard University', 'Boston Logan International Ai…
Given the following locations, ['Massachusetts Institute of Technology', 'Harvard University', 'Boston Logan International Airport'], what would be the optimal route to travel through them all in order to minimize total travel time? Please note the journey begins at the first place listed.