COL7375 Deep Learning

Credit: 3-0-0

Prerequisite: (COL3341) /(COL7341) /(COL3333) /(COL7333)

Overlaps With: COL775

Basics: introduction, multi-layered perceptron, backpropagation, regularization, early stopping. Dropouts, normalization. Optimization: stochastic gradient descent, first-order and second-order methods, standard/advanced optimization algorithms. Convolutional networks (CNNs), standard vision architectures. Recurrent neural networks, LSTMs. Attention, transformers. Word embeddings, language models: BERT, GPT etc. Large language models. Vision language models, for example, CLIP. Generative models: variational auto-encoders, generative adversarial networks, diffusion models. Graph neural networks: graph convolutional networks, graph attention networks, and variations.