| |
|
|
| |
Volume 7, Issue 2, Article 59 |
|
|
|
|
|
| |
Entropy Lower Bounds Related to a Problem of Universal Coding and Prediction
|
| |
|
Authors: |
Flemming Topsoe, |
|
| |
|
Keywords:
|
Entropy, Index of coincidence, Rényi entropy, Measure of roughness, Universal coding, Universal prediction. |
|
| |
|
Date Received:
|
18/08/04 |
|
| |
|
Date Accepted:
|
20/03/06 |
|
| |
|
Subject Codes: |
94A15, 94A17.
|
|
| |
|
Editors: |
Frank Hansen, |
|
| |
|
|
|
|
|
| |
|
Abstract: |
Second order lower bounds for the entropy function expressed in terms of the index of coincidence are derived. Equivalently, these bounds involve entropy and Rényi entropy of order 2. The constants found either explicitly or implicitly are best possible in a natural sense. The inequalities developed originated with certain problems in universal prediction and coding which are briefly discussed.
|
|
|
|
|
|
| |
|
|
|
|
| |
|
|
|
|
|
Home
