Bernal Jimenez edited section_Thresholding_RateSAIL_label_thresh__.tex  about 8 years ago

Commit id: b4ce79625cc623c339d786171b6093aaf62a3d78

deletions | additions      

       

\end{equation}  which are leakiness, linear filtering, and inhibition. $y_j$ is the instantaneous spiking variable for neuron $i$. This circuit may not always descend the objective function, as we can show.  Given the analog optimization problem in \ref{descend}, there are a number of different ways to instantiate a an  LIF circuit to approximate inference. The negative gradient can be interpreted as the driving force in the circuit \begin{equation}  \frac{du_i}{dt} = -\frac{\partial E(a|X; \Phi, W, \theta)}{\partial u_i} = -\frac{\partial E(a|X; \Phi, W, \theta)}{\partial a_i} \frac{\partial a_i}{\partial u_i}  \end{equation}