Summary 6

In this session you learnt about various different topics, let us hear about them from Usha in the upcoming video.

As you saw in the above video, let us summarize what you learnt in this module:

1. Firstly, learnt about two different losses i.e., empirical and theoretical loss and you also saw some of the limitations of the loss functions
    
2. Next, you learnt in detail about the cross-entropy loss function for the classification problem and how it acts as a good surrogate function.
    
3. Next, you learnt about the gradient descent algorithm and the concepts of critical points.
    
4. You solved an example to compute minima, maxima and saddle points for a given equation.
    
5. You learnt about momentum-based optimisers, adam, adagrad and RMS prop. 
    
6. You also learnt about the problem of vanishing and exploding gradients.
    
7. You learnt initializations and their different types, where you learnt about three main types:
   1. 0
   2. Random
   3. he-et-al
8. Lastly, you learnt about the following regularization techniques:
   1. L1 and L2 norms
   2. Dropouts
   3. Batch normalization

Until now, you have been through almost all the parts required to move forward and learn about Convolution Neural Networks and Recurrent Neural Networks.

Report an error