The Backpropagation Algorithm-PART(1): MLP and Sigmoid
What is this post about? The training process of deep Artificial Neural Networks (ANNs) is based on the backpropagation algorithm. Starting with this post, and…
Tag: backpropagation
Back-propagation with Cross-Entropy and Softmax
What will you learn? This post is also available to you in this video, should you be interested 😉 https://www.youtube.com/watch?v=znqbtL0fRA0&feature=youtu.be In our previous post, we…
What is the Delta Rule? (Part-2)
What We Have Learned So Far … So far, we have learned that the Delta rule guarantees to converge to a model that fits our…
What is the Delta Rule? (Part-1)
The Beauty that is the Delta Rule In general, there are 2 main ways to train an Artificial Neural Network (ANN). In our previous post…