Course Title: New age AI in the world LLM

Level: Advanced
Wee Item Item
k Day s s Title
1 1 1 2 Introduction to the course and Introduction to transformers
1 2 3 4 Attention mechanisms in transformers and Deep Dive: Transformer architecture
1 3 5 6 Applications of transformers in NLP and in CV and RL
1 4 - - Quiz & Coding Assignment
2 1 7 8 Language modeling with transformers and Fine-tuning transformers for specific NLP tasks
Pre-training, transfer learning with transformers and Latest breakthroughs in NLP with
2 2 9 10 transformers
2 3 11 12 Introduction to computer vision with transformers and Vision transformers (ViT)
2 4 - - Quiz & Coding Assignment
3 1 13 14 Breakthroughs in computer vision with transformers and Application in image captioning
3 2 15 16 Application in object detection and Introduction to reinforcement learning with transformers
3 3 17 18 Transformer-based reinforcement learning models and Application in game playing
3 4 - - Quiz & Coding Assignment
4 1 19 20 Application in robotics and Latest breakthroughs in RL with transformers
Introduction to speech processing with transformers and Transformer-based
4 2 21 22 models for speech recognition
4 3 23 24 Models for speaker verification and Breakthroughs in speech processing with transformers
4 4 - - Quiz & Coding Assignment
5 1 25 26 Application in audio captioning and Introduction to transformers in biology and medicine
5 2 27 28 Transformers in protein folding and in drug discovery
5 3 29 30 Breakthroughs in biology with transformers and Challenges in biology and medicine
5 4 - - Quiz & Coding Assignment
6 1 31 32 Introduction to multimodal transformers and Applications in image captioning
6 2 33 34 Applications in speech recognition and Breakthroughs in multimodal transformers
6 3 35 36 Recent advances in transformer research and Large-scale pre-training with transformers
6 4 - - Quiz & Coding Assignment
7 1 37 38 Cross-domain transfer learning and Introduction to adversarial attacks and training
7 2 - - Memorization of large language models
7 3 - - Synthetic data issues and privacy
7 4 - - Quiz & Coding Assignment
8 1 39 - Overview of Large Language Models (LLMs)
8 2 40 - Architectures & Training Details of LLMs
8 3 41 - Memory & Computation Challenges in LLMs
8 4 - - Quiz & Coding Assignment
9 1 42 - Introduction to Retrofitting in LLMs
9 2 43 - Fine-tuning and Transfer Learning in LLMs
9 3 44 - LLMs in Multilingual and Cross-lingual Settings
9 4 - - Quiz & Coding Assignment
10 1 45 - LLMs for Text Generation and Creativity
10 2 46 - Ethical Considerations and Bias in LLMs
10 3 47 - Zero-shot, Few-shot and Many-shot Learning with LLMs
10 4 - - Quiz & Coding Assignment
11 1 48 - LLMs in Real-world Applications: Case Studies
11 2 49 - Introduction to Prompt Engineering in LLMs
11 3 50 - Improving Reliability and Interpretability of LLMs
11 4 - - Quiz & Coding Assignment
12 1 51 - Future Directions and Open Challenges for LLMs
12 2 52 - Performance Optimizations and Efficient Implementations for LLMs
12 3 - - Revision & Group Discussions
12 4 - - Final proctored open book exams

Assessment: The assessment will be based on a 60% assignment score, 20% quiz score, and 20%
from the final proctored open book exams.