Advances in Mathematics of Communications

Journal: Advances in Mathematics of Communications

American Institute of Mathematical Sciences

1930-5346
1930-5338

Publications 1 - 1 of 1

Capacity of random channels with large alphabets
Sutter, Tobias; Sutter, David; Lygeros, John (2017)
Advances in Mathematics of Communications
We consider discrete memoryless channels with input alphabet size n and output alphabet size m, where m = [γn] for some constant γ > 0. The channel transition matrix consists of entries that, before being normalized, are independent and identically distributed nonnegative random variables V and such that E[(V log V )2] < ∞. We prove that in the limit as n → ∞ the capacity of such a channel converges to E[(V]=E[V] almost surely and in L2, where Ent[(V) := E[V log V] - E[V] log E[V ] denotes the entropy of V. We further show that, under slightly different model assumptions, the capacity of these random channels converges to this asymptotic value exponentially in n. Finally, we present an application in the context of Bayesian optimal experiment design. © 2017 AIMS.

Publications 1 - 1 of 1