Xavier Holt edited subsection_Prior_for_Weights_In__.tex  over 8 years ago

Commit id: 211642910db3179cab86e9deb7586e79a98665c1

deletions | additions      

       

Using this information, it can be shown that finding the MAP estimator of $\mathbf{w}$ is equivalent to solving the maximum likelihood problem with a ridge regularisation parameter \cite{Hoerl_1970}. The success and ubiquity of this approach then speaks to the reasonableness of assuming Guassian priors. That is,  \begin{align}  \hat{\mathbf{w}} &= \text{argmax}_\mathbf{w} \log \left( \left\{  L(\mathbf{w} \mid \mathcal{D})\times p(\mathbf{w} \mid \boldsymbol{\sigma} )\right)\\ )\right\}\\  & = \text{argmax}_\mathbf{w} \log(L(\mathbf{w} \mid \mathcal{D})) + \log p(\mathbf{w} \mid \boldsymbol{\sigma})\\  & := \text{argmax}_\mathbf{w} \mathcal{l}(\mathbf{w} \mid \mathcal{D}) - (\mathbf{w}^T \boldsymbol{\sigma^{-1}})^2  \end{align}