deletions | additions       diff --git a/subsection_Mutual_Information_definition_and__.tex b/subsection_Mutual_Information_definition_and__.tex  index 7d9e4aa..53ed0fd 100644  --- a/subsection_Mutual_Information_definition_and__.tex  +++ b/subsection_Mutual_Information_definition_and__.tex 
...
Shannon introduced the entropy to be a measure of the quantity of information of a random variable.    Let $X: P \rightarrow E$ be a random variable with $E$ a discrete probability space.  The entropy of $X$ $X$, noted $S(X)$  is defined as: \[ S(X) = -\sum_{x \in E}P_{X}(x)*log(P_{X}(x)) \]    The entropy has three interpretations: