NLP Study (CUAI)

CS224N: Natural Language Processing with Deep Learning

Our Activities

No.	Date	Title	Notes
1	03/17	Lecture 1 - Intro and Word Vectors	L1
		Lecture 2 - Word Vectors and Language Model	L2
		Presentation-1 in Regular Session	Slides
2	03/24	Lecture 3 - Backpropagation & Neural Network	L3
		Lecture 4 - Dependency Parsing	L4
		A Fast and Accurate Dependency Parser using Neural Networks	PPT
3	03/31	Lecture 5 - Recurrent Neural Network	L5
		Lecture 6 - Sequence to Sequence Models	L6 & L7
		Lecture 7 - Attention & LLM Intro	-
		Sequence to Sequence Learning with Neural Networks	PPT
		Presentation-2 in Regular Session	Slides
4	~04/28	Mid-term Exam
5	05/02	Lecture 8 - Self-Attention & Transformers	-
		Lecture 9 - Pretraining	-
		Attention Is All You Need	PPT
		BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding	-
6	05/12	HEGEL: Hypergraph Transformer for Long Document Summarization	PPT
		BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension	PPT
	05/13	Presentation-3 in Regular Session	PPT
7	05/19	Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN	PPT
		Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks	PPT
8	05/26	What do Position Embeddings Learn?	PPT

Name		Name	Last commit message	Last commit date
Latest commit History 83 Commits
pdf		pdf
README.md		README.md