Kim H. Parker edited subsection_c_mutual_information_The__.tex  over 8 years ago

Commit id: c1a10761b07ae5b3c40dd6ab7652ce9f49f46817

deletions | additions      

       

\subsection{c. mutual \subsection{mutual  information} The concept of mutual information was introduced originally in signal analysis where it was proposed as a measure of the mutual information shared by two noisy signals.[refs] The concept is also useful in statistical physics where it is related to the entropy of the system. The theory is very well-developed and the reader is referred to almost any text on information theory for a thorough discussion of the concepts involved. We will use the definition of mutual information based on probability. Given two signals $X$ and $Y$, their mutual information is defined as  \[