this is for holding javascript data
Lucas Fidon edited subsubsection_Mutual_Information_There_are__.tex
almost 8 years ago
Commit id: 575620570f4b437f573c17ed42919960c2d81f12
deletions | additions
diff --git a/subsubsection_Mutual_Information_There_are__.tex b/subsubsection_Mutual_Information_There_are__.tex
index 9bcfa06..a50749d 100644
--- a/subsubsection_Mutual_Information_There_are__.tex
+++ b/subsubsection_Mutual_Information_There_are__.tex
...
The most intuitive definition is the following:
Let $X : P_{1} \rightarrow E_{1}$ and $Y: P_{2} \rightarrow E_{2}$ be two random variables, where $E_{1}$ and $E_{2}$ are two discrete probability spaces.
We define the Mutual information of $X$ and $Y$, noted $I(X,Y)$, as:
\[ I(X,Y) =
\sum_{x \sum_{(x,y) \in
E_1, y \in E_2}P_{(X,Y)}(x,y)*log(\frac{log(P_{(X,Y)}(x,y))}{P_{X}(x)*P_{Y}(y)}) E_1xE_2}P_{(X,Y)}(x,y)*log(\frac{log(P_{(X,Y)}(x,y))}{P_{X}(x)*P_{Y}(y)}) \]