Abstract:
Renyi's (1961) entropy and divergence of order a are given operational characterizations in terms of block coding and hypothesis testing, as so-called /spl beta/-cutoff r...Show MoreMetadata
Abstract:
Renyi's (1961) entropy and divergence of order a are given operational characterizations in terms of block coding and hypothesis testing, as so-called /spl beta/-cutoff rates, with /spl alpha/=(1+/spl beta/)/sup -1/ for entropy and /spl alpha/=(1-/spl beta/)/sup -1/ for divergence. Out of several possible definitions of mutual information and channel capacity of order /spl alpha/, our approach distinguishes one that admits an operational characterization as /spl beta/-cutoff rate for channel coding, with /spl alpha/=(1-/spl beta/)/sup -1/. The ordinary cutoff rate of a DMC corresponds to /spl beta/=-1.<>
Published in: IEEE Transactions on Information Theory ( Volume: 41, Issue: 1, January 1995)
DOI: 10.1109/18.370121