Probably Approximately Correct learning (PAC learning)

E345811

Probably Approximately Correct (PAC) learning is a foundational framework in computational learning theory that formalizes what it means for an algorithm to efficiently learn a concept from examples with high probability and small error.

All labels observed (9)

How this entity was disambiguated

Statements (50)

Predicate Object
instanceOf computational learning theory framework
learning theory model
theoretical framework in machine learning
appliesTo binary classification
multiclass classification
some regression settings
assumes access to labeled examples
i.i.d. examples from an unknown distribution
confidenceParameterSymbol delta
contrastsWith exact learning models
heuristic, non-probabilistic learning notions
coreConcept agnostic case
concept class
distribution over instances
generalization error
hypothesis class
learning algorithm
realizable case
sample complexity
target concept
definesProperty PAC learnability
efficient learnability
errorParameterSymbol epsilon
field Computational Learning Theory
surface form: computational learning theory
formalizes learning from examples
learning with high probability and small error
notion of efficient learnability
goal achieve confidence at least 1 - delta
find hypothesis with error at most epsilon
hasAbbreviation PAC learning
hasVariant Probably Approximately Correct learning (PAC learning) self-linksurface differs
surface form: PAC learning with noise

agnostic PAC learning
distribution-free PAC learning
distribution-specific PAC learning
influenced VC dimension theory
active learning frameworks
boosting algorithms
statistical learning theory
introducedBy Leslie Valiant
introducedIn Probably Approximately Correct learning (PAC learning) self-linksurface differs
surface form: "A Theory of the Learnable"
publicationYear 1984
publishedIn Communications of the ACM
relatedTo VC dimension
empirical risk minimization
uniform convergence
requires polynomial sample complexity in 1/epsilon, 1/delta, and size parameters
polynomial-time learning algorithm for efficient PAC learning
usedFor analyzing learnability of concept classes
characterizing when learning is computationally feasible
deriving bounds on sample complexity

How these facts were elicited

Referenced by (10)

Full triples — surface form annotated when it differs from this entity's canonical label.

Leslie Valiant knownFor Probably Approximately Correct learning (PAC learning)
Leslie Valiant notableWork Probably Approximately Correct learning (PAC learning)
this entity surface form: “A Theory of the Learnable”
poverty of the stimulus argument relatesTo Probably Approximately Correct learning (PAC learning)
this entity surface form: Gold’s theorem in language learnability
Valiant notableFor Probably Approximately Correct learning (PAC learning)
subject surface form: Leslie Valiant
this entity surface form: Probably Approximately Correct learning model
Valiant notableWork Probably Approximately Correct learning (PAC learning)
subject surface form: Leslie Valiant
this entity surface form: "A Theory of the Learnable"
Probably Approximately Correct learning (PAC learning) introducedIn Probably Approximately Correct learning (PAC learning) self-linksurface differs
subject surface form: Probably Approximately Correct learning
this entity surface form: "A Theory of the Learnable"
Probably Approximately Correct learning (PAC learning) hasVariant Probably Approximately Correct learning (PAC learning) self-linksurface differs
subject surface form: Probably Approximately Correct learning
this entity surface form: PAC learning with noise
“Probably Approximately Correct” (book) mainSubject Probably Approximately Correct learning (PAC learning)
subject surface form: Probably Approximately Correct
this entity surface form: PAC learning
“Probably Approximately Correct” (book) title Probably Approximately Correct learning (PAC learning)
subject surface form: Probably Approximately Correct
this entity surface form: Probably Approximately Correct
“Probably Approximately Correct” (book) hasNotableConcept Probably Approximately Correct learning (PAC learning)
subject surface form: Probably Approximately Correct
this entity surface form: PAC learning framework