Further results on geometric properties of a family of relative entropies


Autoria(s): Moses, Ashok Kumar; Sundaresan, Rajesh
Data(s)

2011

Resumo

This paper extends some geometric properties of a one-parameter family of relative entropies. These arise as redundancies when cumulants of compressed lengths are considered instead of expected compressed lengths. These parametric relative entropies are a generalization of the Kullback-Leibler divergence. They satisfy the Pythagorean property and behave like squared distances. This property, which was known for finite alphabet spaces, is now extended for general measure spaces. Existence of projections onto convex and certain closed sets is also established. Our results may have applications in the Rényi entropy maximization rule of statistical physics.

Formato

application/pdf

Identificador

http://eprints.iisc.ernet.in/46145/1/Infor_The_Pro_1940_2011.pdf

Moses, Ashok Kumar and Sundaresan, Rajesh (2011) Further results on geometric properties of a family of relative entropies. In: International Symposium on Information Theory (ISIT), July 31 2011-Aug. 5 2011, St. Petersburg.

Publicador

IEEE

Relação

http://dx.doi.org/10.1109/ISIT.2011.6033890

http://eprints.iisc.ernet.in/46145/

Palavras-Chave #Electrical Communication Engineering
Tipo

Conference Proceedings

PeerReviewed