Encyclopedia > Asymptotic Equipartition Property

  Article Content

Asymptotic equipartition property

Redirected from Asymptotic Equipartition Property

The asymptotic equipartition property (AEP) is a direct consequence of the weak law of large numbers and is used extensively in information theory. It can be summed up by the phrase 'Almost everything is almost equally probable.'

Given i.i.d random variables <math>X_1, X_2, ..., X_n</math> with entropy <math>H(X)</math> and <math>p(X_j, ..., X_k)</math> the probability of observing the sequence <math>X_j, ..., X_k</math>, the AEP states that in all probability,

<math>
{\frac{1}{n}} \log \left( \frac{1}{p(X_1, X_2, ..., X_n)} \right) \rightarrow H(X) </math>

The AEP is used to define the typical set, which is used extensively in theories of compression.



All Wikipedia text is available under the terms of the GNU Free Documentation License

 
  Search Encyclopedia

Search over one million articles, find something about almost anything!
 
 
  
  Featured Article
Dennis Gabor

... - Wikipedia <<Up     Contents Dennis Gabor Dennis Gabor (Gábor Dénes) (1900-1979) was a Hungarian physicist. He invented holography in ...

 
 
 
This page was created in 29 ms