(Day 67) Build a LLM from scratch chapter 3 - self-attention from scratch
March 8, 2024
Hello :) Today is Day 67!
A quick summary of today:
- Covered chapter 3 of Build a LLM from scratch by Sebastian Raschka
(Day 66) Starting Build a LLM from scratch by Sebastian Raschka
March 7, 2024
Hello :) Today is Day 66!
A quick summary of today:
- Chapter 1: Understanding LLMs
- Chapter 2: Working with text data
(Day 65) Stanford CS224N (NLP with DL) - Multimodal DL and Model analysis and explanation
March 6, 2024
Hello :) Today is Day 65!
A quick summary of today:
- Lecture 16: Multimodal deep learning
- Lecture 17: Model analysis and explanation
- (just watched) Lecture 18 and 19: Future of NLP and Model Interpretability & Editing
(Day 64) Stanford CS224N (NLP with DL) - Coreference resolution, Adding knowledge to LMs, Code generation
March 5, 2024
Hello :) Today is Day 64!
A quick summary of today:
- Took some notes from assignment 4 on Natural Machine Translation with RNNs
- Covered Lecture 13 Coreference Resolution
- Lecture 14 Adding knowledge to LMs
- Lecture 15 Code generation
(Day 63) Stanford CS224N (NLP with DL) - Natural Language Generation, Question Answering
March 4, 2024
Hello :) Today is Day 63!
A quick summary of today:
- Lecture 11: Natural Language Generation
- Lecture 12: Question Answering
(Day 62) Stanford CS224N (NLP with DL) - Transformers, Pretraining, RLHF
March 3, 2024
Hello :) Today is Day 62!
A quick summary of today:
- Lecture 8: Self-Attention and Transformers
- Lecture 9: Pretraining
- Lecture 10: Prompting, Reinforcement Learning from Human Feedback