Lucas Fidon edited Another_definition_of_I_X__.tex  almost 8 years ago

Commit id: 8fd67daa7eb49742ccdd7fb5331132cb9dc45687

deletions | additions      

       

Another However the previous  definition of $I(X,Y)$ is: are well nigh impossible to use in practice. Hopefully it can be proved that the Mutual Information between $X$ and $Y$ can be expressed as:  \[ I(X,Y) MI(X,Y)  = \sum_{(x,y) \in E_1\times E_2}P_{(X,Y)}(x,y)log\Bigg(\frac{P_{(X,Y)}(x,y)}{P_{X}(x)P_{Y}(y)}\Bigg) \]