|
Week - 1 |
Introduction: From Biological to Artificial Neurons. The Perceptron. The XOR Problem and Non-Linearity. |
|
Week - 2 |
The Multi-Layer Perceptron (MLP). Activation Functions. |
|
Week - 3 |
Optimization: The Gradient Descent Algorithm. |
|
Week - 4 |
The Backpropagation Algorithm. The Chain Rule and Gradient Calculation. |
|
Week - 5 |
Implementation of Backpropagation Algorithm |
|
Week - 6 |
The TensorFlow and Keras APIs. Building an MLP with Keras. |
|
Week - 7 |
The Training Process: Stochastic Gradient Descent (SGD), Mini-Batch, Epochs. Optimizers (Adam, RMSprop). |
|
Week - 8 |
Overfitting in Deep Networks: Regularization (L2) and Dropout. |
|
Week - 9 |
Convolutional Neural Networks (CNNs) I: Introduction. The Convolutional Layer (Filters, Stride). |
|
Week - 10 |
The Pooling Layer. Coding a simple CNN with Keras. |
|
Week - 11 |
CNN Architectures: LeNet, AlexNet. The Concept of Transfer Learning. |
|
Week - 12 |
Recurrent Neural Networks (RNNs): Sequential Data. The Simple RNN cell and its problems. |
|
Week - 13 |
Vanishing/Exploding Gradients. Long-Short Term Memory and Gated Recurrent Unit Cells. |
|
Week - 14 |
Conceptual Introduction to Autoencoders or Generative Adversarial Networks (GANs). |