Divergence Measures

Data science, information theory, probability theory, statistical learning and other related disciplines greatly benefit from non-negative measures of dissimilarity between pairs of probability measures. These are known as divergence measures, and exploring their mathematical foundations and diverse...

Полное описание

Сохранить в:
Библиографические подробности
Формат: Online
Язык:английский
Опубликовано: MDPI - Multidisciplinary Digital Publishing Institute 2022
Предметы:
Online-ссылка:ONIX_20220621_9783036543321_2
Метки: Добавить метку
Нет меток, Требуется 1-ая метка записи!
_version_ 1863742872170266624
collection Directory of Open Access Books
description Data science, information theory, probability theory, statistical learning and other related disciplines greatly benefit from non-negative measures of dissimilarity between pairs of probability measures. These are known as divergence measures, and exploring their mathematical foundations and diverse applications is of significant interest. The present Special Issue, entitled “Divergence Measures: Mathematical Foundations and Applications in Information-Theoretic and Statistical Problems”, includes eight original contributions, and it is focused on the study of the mathematical properties and applications of classical and generalized divergence measures from an information-theoretic perspective. It mainly deals with two key generalizations of the relative entropy: namely, the R_ényi divergence and the important class of f -divergences. It is our hope that the readers will find interest in this Special Issue, which will stimulate further research in the study of the mathematical foundations and applications of divergence measures.
format Online
id doab-20.500.12854ir-84568
institution Directory of Open Access Books
language eng
publishDate 2022
publishDateRange 2022
publishDateSort 2022
publisher MDPI - Multidisciplinary Digital Publishing Institute
publisherStr MDPI - Multidisciplinary Digital Publishing Institute
record_format ojs
spelling doab-20.500.12854ir-845682024-03-28T03:32:26Z Divergence Measures Sason, Igal Bregman divergence f-divergence Jensen–Bregman divergence Jensen diversity Jensen–Shannon divergence capacitory discrimination Jensen–Shannon centroid mixture family information geometry difference of convex (DC) programming conditional Rényi divergence horse betting Kelly gambling Rényi divergence Rényi mutual information relative entropy chi-squared divergence f-divergences method of types large deviations strong data–processing inequalities information contraction maximal correlation Markov chains information inequalities mutual information Rényi entropy Carlson–Levin inequality information measures hypothesis testing total variation skew-divergence convexity Pinsker’s inequality Bayes risk statistical divergences minimum divergence estimator maximum likelihood bootstrap conditional limit theorem Bahadur efficiency α-mutual information Augustin–Csiszár mutual information data transmission error exponents dimensionality reduction discriminant analysis statistical inference n/a thema EDItEUR::G Reference, Information and Interdisciplinary subjects::GP Research and information: general thema EDItEUR::P Mathematics and Science Data science, information theory, probability theory, statistical learning and other related disciplines greatly benefit from non-negative measures of dissimilarity between pairs of probability measures. These are known as divergence measures, and exploring their mathematical foundations and diverse applications is of significant interest. The present Special Issue, entitled “Divergence Measures: Mathematical Foundations and Applications in Information-Theoretic and Statistical Problems”, includes eight original contributions, and it is focused on the study of the mathematical properties and applications of classical and generalized divergence measures from an information-theoretic perspective. It mainly deals with two key generalizations of the relative entropy: namely, the R_ényi divergence and the important class of f -divergences. It is our hope that the readers will find interest in this Special Issue, which will stimulate further research in the study of the mathematical foundations and applications of divergence measures. 2022-06-21T09:06:09Z 2022-06-21T09:06:09Z 2022 book ONIX_20220621_9783036543321_2 9783036543321 9783036543314 https://directory.doabooks.org/handle/20.500.12854/84568 eng application/octet-stream Attribution 4.0 International https://mdpi.com/books/pdfview/book/5550 https://mdpi.com/books/pdfview/book/5550 MDPI - Multidisciplinary Digital Publishing Institute 10.3390/books978-3-0365-4331-4 10.3390/books978-3-0365-4331-4 46cabcaa-dd94-4bfe-87b4-55023c1b36d0 9783036543321 9783036543314 256 Basel open access
spellingShingle Bregman divergence
f-divergence
Jensen–Bregman divergence
Jensen diversity
Jensen–Shannon divergence
capacitory discrimination
Jensen–Shannon centroid
mixture family
information geometry
difference of convex (DC) programming
conditional Rényi divergence
horse betting
Kelly gambling
Rényi divergence
Rényi mutual information
relative entropy
chi-squared divergence
f-divergences
method of types
large deviations
strong data–processing inequalities
information contraction
maximal correlation
Markov chains
information inequalities
mutual information
Rényi entropy
Carlson–Levin inequality
information measures
hypothesis testing
total variation
skew-divergence
convexity
Pinsker’s inequality
Bayes risk
statistical divergences
minimum divergence estimator
maximum likelihood
bootstrap
conditional limit theorem
Bahadur efficiency
α-mutual information
Augustin–Csiszár mutual information
data transmission
error exponents
dimensionality reduction
discriminant analysis
statistical inference
n/a
thema EDItEUR::G Reference, Information and Interdisciplinary subjects::GP Research and information: general
thema EDItEUR::P Mathematics and Science
Divergence Measures
title Divergence Measures
title_full Divergence Measures
title_fullStr Divergence Measures
title_full_unstemmed Divergence Measures
title_short Divergence Measures
title_sort divergence measures
topic Bregman divergence
f-divergence
Jensen–Bregman divergence
Jensen diversity
Jensen–Shannon divergence
capacitory discrimination
Jensen–Shannon centroid
mixture family
information geometry
difference of convex (DC) programming
conditional Rényi divergence
horse betting
Kelly gambling
Rényi divergence
Rényi mutual information
relative entropy
chi-squared divergence
f-divergences
method of types
large deviations
strong data–processing inequalities
information contraction
maximal correlation
Markov chains
information inequalities
mutual information
Rényi entropy
Carlson–Levin inequality
information measures
hypothesis testing
total variation
skew-divergence
convexity
Pinsker’s inequality
Bayes risk
statistical divergences
minimum divergence estimator
maximum likelihood
bootstrap
conditional limit theorem
Bahadur efficiency
α-mutual information
Augustin–Csiszár mutual information
data transmission
error exponents
dimensionality reduction
discriminant analysis
statistical inference
n/a
thema EDItEUR::G Reference, Information and Interdisciplinary subjects::GP Research and information: general
thema EDItEUR::P Mathematics and Science
topic_facet Bregman divergence
f-divergence
Jensen–Bregman divergence
Jensen diversity
Jensen–Shannon divergence
capacitory discrimination
Jensen–Shannon centroid
mixture family
information geometry
difference of convex (DC) programming
conditional Rényi divergence
horse betting
Kelly gambling
Rényi divergence
Rényi mutual information
relative entropy
chi-squared divergence
f-divergences
method of types
large deviations
strong data–processing inequalities
information contraction
maximal correlation
Markov chains
information inequalities
mutual information
Rényi entropy
Carlson–Levin inequality
information measures
hypothesis testing
total variation
skew-divergence
convexity
Pinsker’s inequality
Bayes risk
statistical divergences
minimum divergence estimator
maximum likelihood
bootstrap
conditional limit theorem
Bahadur efficiency
α-mutual information
Augustin–Csiszár mutual information
data transmission
error exponents
dimensionality reduction
discriminant analysis
statistical inference
n/a
thema EDItEUR::G Reference, Information and Interdisciplinary subjects::GP Research and information: general
thema EDItEUR::P Mathematics and Science
url ONIX_20220621_9783036543321_2