Rényi’s Information Dimension Beyond I.I.D.
Update: 2018-07-24
Description
Co-author: Bernhard C. Geiger (Graz University of Technology)
In 1959, Rényi proposed the information dimension and the d-dimensional entropy to measure the information content of general random variables. Since then, it was shown that the information dimension is of relevance in various areas of information theory, including rate-distortion theory, almost lossless analog compression, or the analysis of interference channels. In this talk, I will propose a generalization of information dimension to stochastic processes, termed information dimension rate. I will then discuss some of its properties and compare it with other generalizations of information dimension available in the literature. I will further show that for Gaussian processes the information dimension rate permits a simple and intuitive characterization in terms of its spectral distribution function.Joint work with Bernhard Geiger (Graz University of Technology).
Related Links
https://arxiv.org/abs/1702.00645 - Link to relevant Arxiv preprint
https://arxiv.org/abs/1712.07863 - Link to relevant Arxiv preprint
In 1959, Rényi proposed the information dimension and the d-dimensional entropy to measure the information content of general random variables. Since then, it was shown that the information dimension is of relevance in various areas of information theory, including rate-distortion theory, almost lossless analog compression, or the analysis of interference channels. In this talk, I will propose a generalization of information dimension to stochastic processes, termed information dimension rate. I will then discuss some of its properties and compare it with other generalizations of information dimension available in the literature. I will further show that for Gaussian processes the information dimension rate permits a simple and intuitive characterization in terms of its spectral distribution function.Joint work with Bernhard Geiger (Graz University of Technology).
Related Links
https://arxiv.org/abs/1702.00645 - Link to relevant Arxiv preprint
https://arxiv.org/abs/1712.07863 - Link to relevant Arxiv preprint
Comments
Top Podcasts
The Best New Comedy Podcast Right Now – June 2024The Best News Podcast Right Now – June 2024The Best New Business Podcast Right Now – June 2024The Best New Sports Podcast Right Now – June 2024The Best New True Crime Podcast Right Now – June 2024The Best New Joe Rogan Experience Podcast Right Now – June 20The Best New Dan Bongino Show Podcast Right Now – June 20The Best New Mark Levin Podcast – June 2024
In Channel