Triple
T13625166
| Position | Surface form | Disambiguated ID | Type / Status |
|---|---|---|---|
| Subject | Andrew Barto |
E325558
|
entity |
| Predicate | publicationTopic |
P1753
|
FINISHED |
| Object |
Markov decision processes
Markov decision processes are mathematical frameworks for modeling decision-making in situations where outcomes are partly random and partly under the control of a decision-maker, widely used in reinforcement learning and control theory.
|
E1051244
|
NE FINISHED |
How this triple was built (4 steps)
Every LLM step that produced this triple, in pipeline order — named-entity classification, the disambiguation choices (the exact options shown, with the pick highlighted), and the generated description. The batch + timestamp of each is in the Provenance table below.
NER
Named-entity recognition
gpt-5-mini
Instruction
Given a phrase, classify it is english named entity (e.g., persons, organizations, works of art) in Latin script, or not (e.g., literals, dates, URLs, verbose phrases). For disambiguation, the statement where the phrase occurs as object is also given. Please return a JSON object with `phrase` (string, the phrase being analyzed) and `is_ne` (boolean, indicating whether the phrase is a Named Entity).
Input
Phrase: Markov decision processes | Statement: [Andrew Barto, publicationTopic, Markov decision processes]
NED1
Entity disambiguation (via context triple)
gpt-5-mini-2025-08-07
Target entity: Markov decision processes Context triple: [Andrew Barto, publicationTopic, Markov decision processes]
-
A.
Foundations of a General Theory of Sequential Decision Functions
Foundations of a General Theory of Sequential Decision Functions is a seminal work in statistics that established the mathematical foundations of sequential analysis and optimal decision-making under uncertainty.
-
B.
Markov processes
Markov processes are stochastic processes in which the future evolution depends only on the present state and not on the past history.
-
C.
Risk-Sensitive Optimal Control
Risk-Sensitive Optimal Control is a foundational work in control theory that develops methods for designing controllers that explicitly account for uncertainty and variability in system performance.
-
D.
Kemeny–Snell finite Markov chain theory
Kemeny–Snell finite Markov chain theory is a foundational mathematical framework that rigorously develops the behavior and long-term properties of finite-state Markov chains, widely used in probability theory and stochastic processes.
-
E.
Introduction to Stochastic Control Theory
Introduction to Stochastic Control Theory is a foundational textbook that systematically develops the theory and methods for controlling dynamical systems under uncertainty using probabilistic and stochastic-process tools.
- F. None of above. chosen
- G. Unsure - the case is ambiguous/there is not enough information to decide.
NEDg
Description generation
gpt-5.1
Instruction
Generate a one-sentence description of the target entity. You are given a context triple in the form (subject, predicate, object), where the object is the target entity. # Instructions Use the triple to infer relevant information about the entity. Describe the entity based on what is most defining, well-known. Avoid repeating the information from the triple, unless really essential. # Response Format Return only the sentence: "Description: [one-sentence description of the target entity]"
Input
Entity: Markov decision processes Triple: [Andrew Barto, publicationTopic, Markov decision processes]
Generated description
Markov decision processes are mathematical frameworks for modeling decision-making in situations where outcomes are partly random and partly under the control of a decision-maker, widely used in reinforcement learning and control theory.
NED2
Entity disambiguation (via description)
gpt-5-mini-2025-08-07
Target entity: Markov decision processes Target entity description: Markov decision processes are mathematical frameworks for modeling decision-making in situations where outcomes are partly random and partly under the control of a decision-maker, widely used in reinforcement learning and control theory.
-
A.
Foundations of a General Theory of Sequential Decision Functions
Foundations of a General Theory of Sequential Decision Functions is a seminal work in statistics that established the mathematical foundations of sequential analysis and optimal decision-making under uncertainty.
-
B.
Markov processes
Markov processes are stochastic processes in which the future evolution depends only on the present state and not on the past history.
-
C.
Risk-Sensitive Optimal Control
Risk-Sensitive Optimal Control is a foundational work in control theory that develops methods for designing controllers that explicitly account for uncertainty and variability in system performance.
-
D.
Kemeny–Snell finite Markov chain theory
Kemeny–Snell finite Markov chain theory is a foundational mathematical framework that rigorously develops the behavior and long-term properties of finite-state Markov chains, widely used in probability theory and stochastic processes.
-
E.
Introduction to Stochastic Control Theory
Introduction to Stochastic Control Theory is a foundational textbook that systematically develops the theory and methods for controlling dynamical systems under uncertainty using probabilistic and stochastic-process tools.
- F. None of above. chosen
Provenance (5 batches)
The batch behind each pipeline step, in order, with when it ran. Timestamps are batch-level — stages were processed in waves, so the object chain (NER → NED1 → NEDg → NED2) reads in order, but predicate / elicitation batches can sit in a different wave.
| Step | Stage | Batch ID | Status | When |
|---|---|---|---|---|
| creating | Elicitation | batch_69d8076aae28819092cf636190ee5529 |
completed | April 9, 2026, 8:09 p.m. |
| NER | Named-entity recognition | batch_69dbbe9c72c88190be3d7a3f2e96afbc |
completed | April 12, 2026, 3:47 p.m. |
| NED1 | Entity disambiguation (via context triple) | batch_69f77fa4c5fc8190bd791f181fce2aa1 |
completed | May 3, 2026, 5:02 p.m. |
| NEDg | Description generation | batch_69f78070e95c819088982e26fe2d8e26 |
completed | May 3, 2026, 5:05 p.m. |
| NED2 | Entity disambiguation (via description) | batch_69f78157b9cc8190a1855cb9715aa7d5 |
completed | May 3, 2026, 5:09 p.m. |
Created at: April 9, 2026, 9:50 p.m.