Triple

T3389735
Position Surface form Disambiguated ID Type / Status
Subject WTO Appellate Body E71387 entity
Predicate proceduralRules P46394 FINISHED
Object Working Procedures for Appellate Review
Working Procedures for Appellate Review are the detailed procedural rules that govern how the World Trade Organization’s Appellate Body conducts and manages appeals in dispute settlement cases.
E353371 NE FINISHED

How this triple was built (5 steps)

Every LLM step that produced this triple, in pipeline order — named-entity classification, the disambiguation choices (the exact options shown, with the pick highlighted), and the generated description. The batch + timestamp of each is in the Provenance table below.

NER Named-entity recognition gpt-5-mini
Instruction
Given a phrase, classify it is english named entity (e.g., persons, organizations, works of art) in Latin script, or not (e.g., literals, dates, URLs, verbose phrases). For disambiguation, the statement where the phrase occurs as object is also given. Please return a JSON object with `phrase` (string, the phrase being analyzed) and `is_ne` (boolean, indicating whether the phrase is a Named Entity).
Input
Phrase: Working Procedures for Appellate Review | Statement: [WTO Appellate Body, proceduralRules, Working Procedures for Appellate Review]
NED1 Entity disambiguation (via context triple) gpt-5-mini-2025-08-07
Target entity: Working Procedures for Appellate Review
Context triple: [WTO Appellate Body, proceduralRules, Working Procedures for Appellate Review]
  • A. Federal Rules of Appellate Procedure for appeals from district courts
    The Federal Rules of Appellate Procedure for appeals from district courts are a set of nationwide procedural rules that govern how cases are taken from U.S. federal trial courts to the federal courts of appeals, including requirements for notices of appeal, briefs, records, and motions.
  • B. Appellate Section
    The Appellate Section is a unit within the U.S. Department of Justice’s Civil Rights Division responsible for handling appeals and developing legal positions in civil rights cases before federal appellate courts and the Supreme Court.
  • C. Appellate Section
    The Appellate Section is a specialized unit within the U.S. Department of Justice’s Criminal Division that handles appeals and develops legal positions in federal criminal cases.
  • D. Division of Appeals and Opinions
    The Division of Appeals and Opinions is a unit within the New York State Attorney General’s office that handles appellate litigation and issues formal legal opinions for the state.
  • E. The Nature of the Judicial Process
    The Nature of the Judicial Process is a classic 1921 legal treatise in which Justice Benjamin N. Cardozo analyzes how judges actually decide cases, exploring the interplay of precedent, logic, and social policy in judicial decision-making.
  • F. None of above. chosen
  • G. Unsure - the case is ambiguous/there is not enough information to decide.
NEDg Description generation gpt-5.1
Instruction
Generate a one-sentence description of the target entity. 
You are given a context triple in the form (subject, predicate, object), where the object is the target entity. 
# Instructions
Use the triple to infer relevant information about the entity. Describe the entity based on what is most defining, well-known. 
Avoid repeating the information from the triple, unless really essential.
# Response Format
Return only the sentence: "Description: [one-sentence description of the target entity]"
Input
Entity: Working Procedures for Appellate Review
Triple: [WTO Appellate Body, proceduralRules, Working Procedures for Appellate Review]
Generated description
Working Procedures for Appellate Review are the detailed procedural rules that govern how the World Trade Organization’s Appellate Body conducts and manages appeals in dispute settlement cases.
NED2 Entity disambiguation (via description) gpt-5-mini-2025-08-07
Target entity: Working Procedures for Appellate Review
Target entity description: Working Procedures for Appellate Review are the detailed procedural rules that govern how the World Trade Organization’s Appellate Body conducts and manages appeals in dispute settlement cases.
  • A. Federal Rules of Appellate Procedure for appeals from district courts
    The Federal Rules of Appellate Procedure for appeals from district courts are a set of nationwide procedural rules that govern how cases are taken from U.S. federal trial courts to the federal courts of appeals, including requirements for notices of appeal, briefs, records, and motions.
  • B. Appellate Section
    The Appellate Section is a unit within the U.S. Department of Justice’s Civil Rights Division responsible for handling appeals and developing legal positions in civil rights cases before federal appellate courts and the Supreme Court.
  • C. Appellate Section
    The Appellate Section is a specialized unit within the U.S. Department of Justice’s Criminal Division that handles appeals and develops legal positions in federal criminal cases.
  • D. Division of Appeals and Opinions
    The Division of Appeals and Opinions is a unit within the New York State Attorney General’s office that handles appellate litigation and issues formal legal opinions for the state.
  • E. The Nature of the Judicial Process
    The Nature of the Judicial Process is a classic 1921 legal treatise in which Justice Benjamin N. Cardozo analyzes how judges actually decide cases, exploring the interplay of precedent, logic, and social policy in judicial decision-making.
  • F. None of above. chosen
PD Predicate disambiguation gpt-5-mini-2025-08-07
Target predicate: proceduralRules
Context triple: [WTO Appellate Body, proceduralRules, Working Procedures for Appellate Review]
  • A. adoptedRulesOfProcedureOn
    Indicates that an entity formally established or approved rules of procedure on a specific date or occasion.
  • B. protocolRule
    Indicates that a specified rule or constraint governs how a protocol should be used, structured, or executed between entities.
  • C. compositionRule
    Indicates how multiple elements or components are combined or arranged according to a specific rule or pattern.
  • D. rulesOfPractice chosen
    Indicates the formal procedures, standards, or guidelines that govern how a particular activity, profession, or process must be conducted.
  • E. decisionMakingRule
    Indicates the principle, guideline, or procedure that governs how a decision is made in a given context.
  • F. None of above.

Provenance (6 batches)

The batch behind each pipeline step, in order, with when it ran. Timestamps are batch-level — stages were processed in waves, so the object chain (NER → NED1 → NEDg → NED2) reads in order, but predicate / elicitation batches can sit in a different wave.

Step Stage Batch ID Status When
creating Elicitation batch_69ad85a8fd9c819095ecedf838d2bf1b completed March 8, 2026, 2:20 p.m.
NER Named-entity recognition batch_69adb666e514819090560d43bfaf55b8 completed March 8, 2026, 5:48 p.m.
NED1 Entity disambiguation (via context triple) batch_69b3345a95ac819098be25233b8e0ed5 completed March 12, 2026, 9:47 p.m.
NEDg Description generation batch_69b33542a1008190a1cc4aec663d97bc completed March 12, 2026, 9:50 p.m.
NED2 Entity disambiguation (via description) batch_69b3391c4e24819082e9a0f50c1afab8 completed March 12, 2026, 10:07 p.m.
PD Predicate disambiguation batch_69ada43615f08190ac2275020d157983 completed March 8, 2026, 4:30 p.m.
Created at: March 8, 2026, 3:14 p.m.