Triple

T13625166
Position Surface form Disambiguated ID Type / Status
Subject Andrew Barto E325558 entity
Predicate publicationTopic P1753 FINISHED
Object Markov decision processes
Markov decision processes are mathematical frameworks for modeling decision-making in situations where outcomes are partly random and partly under the control of a decision-maker, widely used in reinforcement learning and control theory.
E1051244 NE FINISHED

How this triple was built (4 steps)

Every LLM step that produced this triple, in pipeline order — named-entity classification, the disambiguation choices (the exact options shown, with the pick highlighted), and the generated description. The batch + timestamp of each is in the Provenance table below.

NER Named-entity recognition gpt-5-mini
Instruction
Given a phrase, classify it is english named entity (e.g., persons, organizations, works of art) in Latin script, or not (e.g., literals, dates, URLs, verbose phrases). For disambiguation, the statement where the phrase occurs as object is also given. Please return a JSON object with `phrase` (string, the phrase being analyzed) and `is_ne` (boolean, indicating whether the phrase is a Named Entity).
Input
Phrase: Markov decision processes | Statement: [Andrew Barto, publicationTopic, Markov decision processes]
NED1 Entity disambiguation (via context triple) gpt-5-mini-2025-08-07
Target entity: Markov decision processes
Context triple: [Andrew Barto, publicationTopic, Markov decision processes]
  • A. Foundations of a General Theory of Sequential Decision Functions
    Foundations of a General Theory of Sequential Decision Functions is a seminal work in statistics that established the mathematical foundations of sequential analysis and optimal decision-making under uncertainty.
  • B. Markov processes
    Markov processes are stochastic processes in which the future evolution depends only on the present state and not on the past history.
  • C. Risk-Sensitive Optimal Control
    Risk-Sensitive Optimal Control is a foundational work in control theory that develops methods for designing controllers that explicitly account for uncertainty and variability in system performance.
  • D. Kemeny–Snell finite Markov chain theory
    Kemeny–Snell finite Markov chain theory is a foundational mathematical framework that rigorously develops the behavior and long-term properties of finite-state Markov chains, widely used in probability theory and stochastic processes.
  • E. Introduction to Stochastic Control Theory
    Introduction to Stochastic Control Theory is a foundational textbook that systematically develops the theory and methods for controlling dynamical systems under uncertainty using probabilistic and stochastic-process tools.
  • F. None of above. chosen
  • G. Unsure - the case is ambiguous/there is not enough information to decide.
NEDg Description generation gpt-5.1
Instruction
Generate a one-sentence description of the target entity. 
You are given a context triple in the form (subject, predicate, object), where the object is the target entity. 
# Instructions
Use the triple to infer relevant information about the entity. Describe the entity based on what is most defining, well-known. 
Avoid repeating the information from the triple, unless really essential.
# Response Format
Return only the sentence: "Description: [one-sentence description of the target entity]"
Input
Entity: Markov decision processes
Triple: [Andrew Barto, publicationTopic, Markov decision processes]
Generated description
Markov decision processes are mathematical frameworks for modeling decision-making in situations where outcomes are partly random and partly under the control of a decision-maker, widely used in reinforcement learning and control theory.
NED2 Entity disambiguation (via description) gpt-5-mini-2025-08-07
Target entity: Markov decision processes
Target entity description: Markov decision processes are mathematical frameworks for modeling decision-making in situations where outcomes are partly random and partly under the control of a decision-maker, widely used in reinforcement learning and control theory.
  • A. Foundations of a General Theory of Sequential Decision Functions
    Foundations of a General Theory of Sequential Decision Functions is a seminal work in statistics that established the mathematical foundations of sequential analysis and optimal decision-making under uncertainty.
  • B. Markov processes
    Markov processes are stochastic processes in which the future evolution depends only on the present state and not on the past history.
  • C. Risk-Sensitive Optimal Control
    Risk-Sensitive Optimal Control is a foundational work in control theory that develops methods for designing controllers that explicitly account for uncertainty and variability in system performance.
  • D. Kemeny–Snell finite Markov chain theory
    Kemeny–Snell finite Markov chain theory is a foundational mathematical framework that rigorously develops the behavior and long-term properties of finite-state Markov chains, widely used in probability theory and stochastic processes.
  • E. Introduction to Stochastic Control Theory
    Introduction to Stochastic Control Theory is a foundational textbook that systematically develops the theory and methods for controlling dynamical systems under uncertainty using probabilistic and stochastic-process tools.
  • F. None of above. chosen

Provenance (5 batches)

The batch behind each pipeline step, in order, with when it ran. Timestamps are batch-level — stages were processed in waves, so the object chain (NER → NED1 → NEDg → NED2) reads in order, but predicate / elicitation batches can sit in a different wave.

Step Stage Batch ID Status When
creating Elicitation batch_69d8076aae28819092cf636190ee5529 completed April 9, 2026, 8:09 p.m.
NER Named-entity recognition batch_69dbbe9c72c88190be3d7a3f2e96afbc completed April 12, 2026, 3:47 p.m.
NED1 Entity disambiguation (via context triple) batch_69f77fa4c5fc8190bd791f181fce2aa1 completed May 3, 2026, 5:02 p.m.
NEDg Description generation batch_69f78070e95c819088982e26fe2d8e26 completed May 3, 2026, 5:05 p.m.
NED2 Entity disambiguation (via description) batch_69f78157b9cc8190a1855cb9715aa7d5 completed May 3, 2026, 5:09 p.m.
Created at: April 9, 2026, 9:50 p.m.