判例与法规检索(含引注)
Case-law & statute research with citations
Find controlling authority and verify every citation.
20 条本项目编写的提案 · 分类 v1.1 · 新增基准运行 0 次。下方验证方式与部分得分规则是设计,不是执行结果。
- 典型应用
- Westlaw · Lexis+ · CourtListener
- 小类 GUI 需求标签
HY· 混合
任务提案 · 20
展开查看完整原文与建议检查方式;两种界面均保留提案英文原文。
R10.02.01.01-T01 Retrieve a current regulation's operative text and last-amended citation
原始指令
A client asks how many hours of service an employee needs for FMLA eligibility. Using eCFR in the browser, find the operative provision in 29 C.F.R. Part 825, and record in output/answer.json: the section and paragraph citation, the hour threshold, the quoted operative sentence, and the Federal Register citation listed as the section's most recent amendment source.
- 平台
web· 任意系统(网页)- 应用
- eCFR · govinfo
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
HY· 混合- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动type· 文字与表单- 工作产物
WP12· 答案 / 决策- 条件
- 未声明
- 提案难度
- 2 / 5
建议验证方式
answer.json fields vs curated key: paragraph cite exact, number exact, quote string-match >= 0.95 to the eCFR text as of the frozen snapshot date, FR citation exact. Snapshot pinned so answers do not drift.
建议部分得分
35% citation; 25% threshold; 20% quote; 20% FR source.
R10.02.01.01-T02 Find the controlling appellate decision on an issue and give its pin cite
原始指令
Issue memo input/issue_delegation.pdf asks whether, in the Ninth Circuit, a court or the arbitrator decides arbitrability when the clause incorporates AAA rules. Using Westlaw (or Lexis+), identify the controlling published Ninth Circuit decision, its reporter citation, the pin cite for the holding, and whether it remains good law. Write output/authority.json.
- 平台
web· 任意系统(网页)- 应用
- Westlaw · Lexis+
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
HY· 混合- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动type· 文字与表单click· 指向与点击- 工作产物
WP12· 答案 / 决策- 条件
licensed· 授权专业软件- 提案难度
- 3 / 5
建议验证方式
Curated key: case name and reporter citation exact; pin cite within the accepted page set; good-law status matches the citator flag on the snapshot date. Fabricated or non-precedential cites score 0 for that field.
建议部分得分
45% correct case; 25% reporter cite; 20% pin cite; 10% status.
R10.02.01.01-T03 Run citator checks on twelve authorities and flag negative treatment
原始指令
input/brief_draft.docx cites 12 cases. Run KeyCite on each in Westlaw. For every case with red or yellow flag, record the flag, the most serious negative citing case (name and citation) and whether the negative treatment concerns the proposition the brief cites it for. Save output/citator_table.xlsx.
- 平台
web· 任意系统(网页)- 应用
- Westlaw · Excel
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
G2· GUI 必要- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
click· 指向与点击nav· 平移 / 缩放 / 滚动multi· 跨应用- 工作产物
WP02· 记录 / 表格- 条件
licensed· 授权专业软件multiapp· 多应用- 提案难度
- 3 / 5
建议验证方式
Rows vs curated key: flag color per case exact (12); negative citing case exact for the 5 flagged cases; proposition-relevance Y/N exact. Westlaw API access is denied to the account, and the research history export must confirm a KeyCite view for each of the 12 cases.
建议部分得分
35% flags; 40% negative citing cases; 25% relevance calls.
R10.02.01.01-T04 Cite-check a 30-citation brief including fabricated authorities
原始指令
input/opposition_brief.docx contains 30 citations to cases and statutes. Verify each: the authority exists, volume/reporter/page are right, the pin cite supports the quoted or paraphrased text, and Bluebook form. Several citations may be fabricated. Produce output/citecheck.xlsx (cite, exists Y/N, corrected cite, pin OK Y/N, issue) using CourtListener plus Westlaw or Lexis+.
- 平台
web· 任意系统(网页)- 应用
- CourtListener · Westlaw · Lexis+
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
HY· 混合- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动type· 文字与表单multi· 跨应用- 工作产物
WP02· 记录 / 表格- 条件
licensed· 授权专业软件multiapp· 多应用- 提案难度
- 4 / 5
建议验证方式
Per-row vs curated key: existence exact (5 seeded fabrications must be N), corrected cite exact for 8 seeded mis-cites, pin-support flag exact for 6 seeded misquotes; F1 over seeded issues >= 0.85.
建议部分得分
35% fabrications caught; 30% corrected cites; 25% pin/quote problems; 10% Bluebook fixes.
R10.02.01.01-T05 Trace an amendment to its public law and Statutes at Large citation
原始指令
The current text of 15 U.S.C. section 1681c(a)(5) was changed by a later act. Using Congress.gov, govinfo and the U.S. Code notes, record in output/history.json the amending public law number, its Statutes at Large citation, enactment date, and the exact words added or removed.
- 平台
web· 任意系统(网页)- 应用
- Congress.gov · govinfo · uscode.house.gov
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
HY· 混合- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动type· 文字与表单- 工作产物
WP12· 答案 / 决策- 条件
- 未声明
- 提案难度
- 3 / 5
建议验证方式
Curated key: Pub. L. number, Stat. cite and date exact; changed text token-F1 >= 0.9 against the enrolled bill language. Snapshot of sites pinned.
建议部分得分
30% public law; 25% Stat. cite; 15% date; 30% changed text.
R10.02.01.01-T06 Build a fifteen-state survey of contract limitation periods with verified citations
原始指令
For the 15 states in input/states.txt, find the statute of limitations for actions on written contracts (and any separate period for sale-of-goods contracts under UCC 2-725 as adopted). Record period, code citation, and one appellate case applying it with reporter cite, in output/sol_survey.xlsx. Use Lexis+ or Westlaw and verify every code section on the official legislature site.
- 平台
web· 任意系统(网页)- 应用
- Lexis+ · Westlaw · state legislature sites · Excel
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
HY· 混合- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动type· 文字与表单multi· 跨应用- 工作产物
WP02· 记录 / 表格- 条件
licensed· 授权专业软件long· 长流程multiapp· 多应用- 提案难度
- 5 / 5
建议验证方式
Curated key per state: period exact; code citation exact; UCC period and cite exact; case cite must exist (grader checks via CourtListener citation lookup) and apply the cited section (curated acceptable set). Pass >= 90% of cells.
建议部分得分
35% periods; 30% code cites; 15% UCC rows; 20% valid applying cases.
R10.02.01.01-T07 Pull an opinion and its docket from CourtListener
原始指令
In CourtListener, find the opinion in docket 'Halvorsen v. Kestrel Freight' (seeded mirror case) decided in 2025, download the opinion PDF to output/opinion.pdf, and record in output/meta.json the court, date filed, author judge, citation if published, and the docket number.
- 平台
web· 任意系统(网页)- 应用
- CourtListener
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
HY· 混合- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动click· 指向与点击- 工作产物
WP12· 答案 / 决策- 条件
- 未声明
- 提案难度
- 1 / 5
建议验证方式
opinion.pdf hash equals the mirror file; meta.json fields exact against the mirror's database row.
建议部分得分
40% correct PDF; 60% metadata fields (pro rata per field).
R10.02.01.01-T08 Find the five most on-point circuit decisions interpreting a statutory element
原始指令
Research question input/q_ada_qualified.txt: how the Seventh Circuit has applied the 'essential functions' element of 42 U.S.C. 12111(8) to attendance requirements since 2018. Using Westlaw or Lexis+ (headnotes, citing references), list the 5 most on-point published decisions with citation, pin cite and a one-sentence holding in output/top5.json.
- 平台
web· 任意系统(网页)- 应用
- Westlaw · Lexis+
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
HY· 混合- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动type· 文字与表单click· 指向与点击- 工作产物
WP12· 答案 / 决策- 条件
licensed· 授权专业软件- 提案难度
- 3 / 5
建议验证方式
Precision of the 5 cases against an expert-curated relevant set (>= 4 of 5 in set to pass); citations exact; pin cites within the accepted page ranges; holding sentences scored by LLM rubric (only 15%).
建议部分得分
55% precision vs curated set; 20% citations; 10% pin cites; 15% holdings (LLM rubric).
R10.02.01.01-T09 Compare two point-in-time versions of a regulation and source the change
原始指令
Using eCFR's point-in-time and compare views, determine how 40 C.F.R. section 60.5397a changed between 2023-01-01 and the snapshot date. Write output/reg_change.json with each changed paragraph, old and new text, the Federal Register citation and effective date of each amending rule, and produce a redline PDF output/redline.pdf from the site's compare view.
- 平台
web· 任意系统(网页)- 应用
- eCFR · Federal Register
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
HY· 混合- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动vis· 视觉判断click· 指向与点击- 工作产物
WP01· 文档- 条件
- 未声明
- 提案难度
- 4 / 5
建议验证方式
Changed-paragraph set exact vs key; old/new text token-F1 >= 0.95; FR cites and effective dates exact; redline.pdf exists and contains the insertion/deletion markup for those paragraphs.
建议部分得分
35% changed paragraphs; 25% texts; 25% FR sources; 15% redline export.
R10.02.01.01-T10 Organize a Westlaw research folder with highlighted holdings
原始指令
In Westlaw, create folder 'Kestrel - Fuel Surcharge' with subfolders 'Contract formation' and 'Damages'. Save the 8 authorities listed in input/authorities.txt into the right subfolders, highlight the holding passage in each and add a note naming the proposition, then export the folder's annotations report to output/folder_report.pdf.
- 平台
web· 任意系统(网页)- 应用
- Westlaw
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
G3· 仅 GUI- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
click· 指向与点击path· 连续路径type· 文字与表单- 工作产物
WP10· 标注- 条件
licensed· 授权专业软件- 提案难度
- 3 / 5
建议验证方式
folder_report.pdf parsed: folder structure and 8 documents in correct subfolders; each has a highlight overlapping the curated holding passage (>= 60% token overlap) and a note. Westlaw API access is denied to the account, so folders, highlights and notes can be created only in the Westlaw UI; the report must be Westlaw's own export.
建议部分得分
30% folders and placement; 45% highlights on holdings; 25% notes and report.
R10.02.01.01-T11 Supply star-paginated pin cites for ten quotations
原始指令
input/memo_quotes.docx has 10 quotations from 6 Supreme Court opinions with only 'U.S. ___' placeholders for pin cites. Using star pagination in Westlaw or Lexis+, insert the exact U.S. Reports page (and S. Ct. parallel page) where each quoted passage begins, and save output/memo_pinned.docx.
- 平台
web· 任意系统(网页)mac· macOSwin· Windows- 应用
- Westlaw · Lexis+ · Word
- 交互表面
brow· 浏览器desk· 桌面 GUI- GUI 需求 · 任务设定
G2· GUI 必要- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动vis· 视觉判断multi· 跨应用- 工作产物
WP01· 文档- 条件
licensed· 授权专业软件multiapp· 多应用- 提案难度
- 4 / 5
建议验证方式
Each of 10 pin cites equals the curated U.S. page (passages spanning a page break accept the starting page) and S. Ct. page; no other text changed in the docx. Westlaw and Lexis+ API access is denied, so star pages are reachable only in the research UI; research history must show the 6 opinions viewed in the session.
建议部分得分
60% U.S. pins; 30% S. Ct. pins; 10% document otherwise unchanged.
R10.02.01.01-T12 Write a choice-of-law research memo with fully verified authorities
原始指令
input/assignment.pdf: a Delaware-law choice-of-law clause in a contract performed in California; does California's non-compete ban (Bus. & Prof. Code 16600, 16600.5) override it? Research both states, then write output/memo.docx (question, short answer, analysis, table of authorities) citing only authorities you verified, each with pin cites.
- 平台
web· 任意系统(网页)mac· macOSwin· Windows- 应用
- Westlaw · Lexis+ · Word
- 交互表面
brow· 浏览器desk· 桌面 GUI- GUI 需求 · 任务设定
HY· 混合- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动type· 文字与表单multi· 跨应用- 工作产物
WP01· 文档- 条件
licensed· 授权专业软件long· 长流程multiapp· 多应用- 提案难度
- 5 / 5
建议验证方式
Every citation in memo.docx must resolve (grader citation lookup) and appear in the TOA; recall of 6 must-cite authorities; short answer matches the curated conclusion; analysis quality by LLM rubric (25%). Any fabricated cite caps the score at 30%.
建议部分得分
30% must-cite recall; 25% no fabricated/mis-cited authority; 20% short answer; 25% analysis (LLM rubric).
R10.02.01.01-T13 Determine whether a state statute was amended or repealed and cite the session law
原始指令
A 2019 memo relies on Texas Property Code section 92.0563. Using the Texas Legislature Online site and the current code, determine whether the section was amended or repealed after 2019, identify the session law (bill number, chapter, session) and effective date, and record the current text in output/currency.json.
- 平台
web· 任意系统(网页)- 应用
- Texas Legislature Online · statutes.capitol.texas.gov
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
HY· 混合- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动type· 文字与表单- 工作产物
WP12· 答案 / 决策- 条件
- 未声明
- 提案难度
- 3 / 5
建议验证方式
Curated key: amended/repealed status exact; bill, chapter, session and effective date exact; current text token-F1 >= 0.95 against the snapshot.
建议部分得分
30% status; 45% session-law details; 25% current text.
R10.02.01.01-T14 Convert fifteen citations to Bluebook form with parallel cites
原始指令
input/raw_cites.txt lists 15 citations in mixed styles (neutral cites, Westlaw cites, state reporters). Using CourtListener's citation lookup and the court's rules for parallel cites in input/local_rule_cites.pdf, rewrite each in Bluebook form with the required parallel citation and court/year parenthetical. Save output/cites_bluebook.txt.
- 平台
web· 任意系统(网页)- 应用
- CourtListener
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
HY· 混合- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动type· 文字与表单- 工作产物
WP01· 文档- 条件
- 未声明
- 提案难度
- 2 / 5
建议验证方式
Each line string-compared to the curated Bluebook form after whitespace normalization; partial credit per element (reporter, page, parallel, parenthetical).
建议部分得分
40% primary reporter cites; 30% parallel cites; 30% parentheticals.
R10.02.01.01-T15 Locate an unpublished district order in RECAP and cite it properly
原始指令
A colleague remembers a 2024 order in 'Pinecrest HOA v. Valmont' (seeded mirror case, D. Colo.) denying class certification. Find the docket in CourtListener RECAP, identify the docket entry number and date of the order, download it to output/order.pdf, and write its proper citation (no reporter: docket number, ECF No., court, date) in output/cite.txt.
- 平台
web· 任意系统(网页)- 应用
- CourtListener RECAP
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
HY· 混合- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动click· 指向与点击- 工作产物
WP12· 答案 / 决策- 条件
- 未声明
- 提案难度
- 3 / 5
建议验证方式
order.pdf hash equals the mirror document; cite.txt matches the curated citation (case name, No., ECF No., court, exact date) after normalization. A similarly named order granting a different motion is seeded as a distractor.
建议部分得分
50% correct document; 50% citation elements.
R10.02.01.01-T16 Use a practice guide to find leading cases and confirm they are good law
原始指令
In Lexis+ open the practice-guide/treatise section on 'implied covenant of good faith - termination at will' for New York. Record the section citation, the 3 leading New York Court of Appeals cases it relies on, and run Shepard's on each to confirm treatment. Save output/treatise_cases.json.
- 平台
web· 任意系统(网页)- 应用
- Lexis+
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
G2· GUI 必要- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动click· 指向与点击- 工作产物
WP12· 答案 / 决策- 条件
licensed· 授权专业软件- 提案难度
- 3 / 5
建议验证方式
Treatise section cite exact; 3 cases equal the curated set (order-free) with citations exact; Shepard's signal per case matches the snapshot. Lexis+ API is not available to the account.
建议部分得分
25% section cite; 50% cases; 25% Shepard's signals.
R10.02.01.01-T17 Audit an AI-drafted brief for hallucinated authorities and correct it with tracked changes
原始指令
input/ai_draft_brief.docx (synthetic matter) has 40 citations; some cases do not exist, some are real but misquoted, and some have wrong pin cites or holdings. Verify each with CourtListener and Westlaw/Lexis+, then fix the brief in Word with Track Changes: replace or delete bad authorities, correct pins and quotes, and add a comment on each change explaining it.
- 平台
web· 任意系统(网页)mac· macOSwin· Windows- 应用
- CourtListener · Westlaw · Word
- 交互表面
brow· 浏览器desk· 桌面 GUI- GUI 需求 · 任务设定
HY· 混合- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动type· 文字与表单multi· 跨应用- 工作产物
WP01· 文档- 条件
licensed· 授权专业软件long· 长流程multiapp· 多应用- 提案难度
- 5 / 5
建议验证方式
docx revision XML: every seeded problem (7 fabricated, 6 misquoted, 5 wrong pin) has a w:ins/w:del change at that citation and an anchored comment; replacement authorities resolve and support the proposition (curated acceptable set); no new unverifiable cites.
建议部分得分
35% fabricated cites removed/replaced; 25% misquotes fixed; 20% pins fixed; 20% comments and no new errors.
R10.02.01.01-T18 Trace a decision's subsequent history and write the full citation
原始指令
For the 6 circuit decisions in input/cases_history.txt, use KeyCite or Shepard's history views to find all subsequent history (rehearing en banc, reversed, cert. denied with date) and write each full Bluebook citation with subsequent history in output/history_cites.txt.
- 平台
web· 任意系统(网页)- 应用
- Westlaw · Lexis+
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
G2· GUI 必要- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动click· 指向与点击type· 文字与表单- 工作产物
WP01· 文档- 条件
licensed· 授权专业软件- 提案难度
- 4 / 5
建议验证方式
Per case vs curated: each history element (action, court, citation, year) exact; cert-denied citations include the S. Ct. cite where available on the snapshot date; Bluebook ordering correct. No Westlaw/Lexis API key is issued; every history element must appear in the agent's KeyCite/Shepard's views in the UI session log, so cites taken from other sources fail.
建议部分得分
60% history elements; 25% citations; 15% formatting.
R10.02.01.01-T19 Verify the same twelve citations through the CourtListener API (control)
原始指令
Control pair of T03. Using the CourtListener REST API (token in env CL_TOKEN), resolve each of the 12 citations from input/brief_cites.txt, list citing opinions, and classify any negative treatment you can establish from the citing opinions' text; write output/citator_api.csv.
- 平台
lin· Linux- 应用
- CourtListener API · Python
- 交互表面
api· API / SDKterm· 终端- GUI 需求 · 任务设定
AP· API 足够- GUI 需求 · 普通权限
AP· API 足够- 交互原语
code· 代码与命令- 工作产物
WP02· 记录 / 表格- 条件
- 未声明
- 提案难度
- 3 / 5
建议验证方式
Same key as T03 for existence and negative citing case; flags derived from citing text. Measures what a public API recovers versus the commercial citator GUI.
建议部分得分
30% citations resolved; 45% negative citing cases; 25% classification.
R10.02.01.01-T20 Find interpreting cases through statutory annotations and verify each
原始指令
In Westlaw's annotated U.S. Code, open the Notes of Decisions for 47 U.S.C. section 227(a)(1) and identify the 3 most recent published circuit decisions interpreting 'automatic telephone dialing system' after the Supreme Court's 2021 decision on the term. Record citation, pin cite and holding sentence, confirm each is good law, in output/annotations.json.
- 平台
web· 任意系统(网页)- 应用
- Westlaw
- 交互表面
brow· 浏览器- GUI 需求 · 任务设定
G2· GUI 必要- GUI 需求 · 普通权限
G2· GUI 必要- 交互原语
nav· 平移 / 缩放 / 滚动click· 指向与点击- 工作产物
WP12· 答案 / 决策- 条件
licensed· 授权专业软件- 提案难度
- 4 / 5
建议验证方式
3 cases equal the curated set as of the snapshot (order-free); citations and pin cites exact; KeyCite status matches snapshot; holding sentence overlaps curated holding by >= 60% tokens. Westlaw API access is denied to the account, and research history must show the Notes of Decisions view and a KeyCite view for each case from the session.
建议部分得分
50% correct cases; 25% cites and pins; 10% status; 15% holding sentences.
已有研究映射
以下沿用研究目录中的基准与小类映射,不是逐题标注、执行记录或产品背书。