Tsallis divergence
E212974
concept in nonextensive statistical mechanics
f-divergence generalization
information theoretic measure
statistical divergence
Tsallis divergence is a generalized measure of statistical distance between probability distributions derived from Tsallis entropy, often used in nonextensive statistical mechanics and information theory.
All labels observed (1)
| Label | Occurrences |
|---|---|
| Tsallis divergence canonical | 1 |
Statements (47)
| Predicate | Object |
|---|---|
| instanceOf |
concept in nonextensive statistical mechanics
ⓘ
f-divergence generalization ⓘ information theoretic measure ⓘ statistical divergence ⓘ |
| appliedIn |
anomalous diffusion modeling
ⓘ
complex systems ⓘ image processing ⓘ pattern recognition ⓘ statistical physics of long-range interactions ⓘ |
| associatedWith |
nonextensive entropy formalism
ⓘ
power-law distributed systems ⓘ |
| basedOn | Tsallis entropy ⓘ |
| category | generalized information measure ⓘ |
| dependsOn |
probability distribution P
ⓘ
probability distribution Q ⓘ |
| domain |
continuous probability distributions
ⓘ
discrete probability distributions ⓘ |
| field |
information theory
ⓘ
machine learning ⓘ statistical mechanics ⓘ statistics ⓘ |
| generalizes | Kullback–Leibler divergence ⓘ |
| invariantUnder | relabeling of outcomes ⓘ |
| mathematicalForm | q-deformed divergence ⓘ |
| namedAfter | Constantino Tsallis ⓘ |
| parameter | entropic index q ⓘ |
| property |
equals zero iff P = Q (under suitable conditions)
ⓘ
nonnegative ⓘ |
| reducesTo | Kullback–Leibler divergence when q → 1 ⓘ |
| relatedTo |
Bregman divergence
ⓘ
Csiszár f-divergence ⓘ Rényi divergence ⓘ |
| requires | choice of entropic index q ≠ 1 ⓘ |
| specialCaseOf | q-deformed information measures ⓘ |
| usedFor |
constructing generalized maximum entropy principles
ⓘ
defining generalized relative entropy ⓘ measuring statistical distance between probability distributions ⓘ robust loss functions in learning algorithms ⓘ |
| usedIn |
clustering
ⓘ
hypothesis testing ⓘ information geometry ⓘ model selection ⓘ nonextensive statistical mechanics ⓘ robust statistics ⓘ signal processing ⓘ statistical inference ⓘ |
| yearProposed | 1990s (approximate) ⓘ |
Referenced by (1)
Full triples — surface form annotated when it differs from this entity's canonical label.