Cover Image for AI Master's Popup: Neural Networks (building gpt tokenizer p2)
Cover Image for AI Master's Popup: Neural Networks (building gpt tokenizer p2)
9 Went

AI Master's Popup: Neural Networks (building gpt tokenizer p2)

Hosted by Alex Paden & Network School
Registration
Past Event
Welcome! To join the event, please register below.
About Event

​THIS IS A DAILY EVENT (weekdays)

​New content every day.

​This event is not beginner-friendly — background knowledge is mostly required (though experience levels vary). Feel free to message me if you're unsure. The goal is to cover top university master’s-level content in less time.

​This is a group class, no official teacher. We currently follow Karpathy; pause, ask questions, and answer ourselves. Be respectful. The class is small.

​We'll be discussing an ongoing series of AI-learning sessions, initially focused on Andrej Karpathy's Zero-to-Hero Neural Network playlist — covering GPT-2, backpropagation, tokenizers, and more. The course began partway through July. We'll finish the final two videos (GPT tokenizer + GPT-2 from scratch) in August, then shift to pre-training a GPT-2 model in class, followed by fine-tuning it into a chat assistant (see the end of Karpathy’s “GPT from scratch” video to understand the challenge of fine-tuning).

​Playlist:
Watch on YouTube

​If you're new to NS in August (or were around but didn’t join), you’re still welcome! Ideally, watch the full 6-hour tokenizer + GPT-2 set at the start of August if you want to join the pretraining work later.

​Month 1 Curriculum (spills into early August):
https://www.notion.so/shonixyz/Advanced-AI-Learnathon-Zero-to-Hero-231d8b25071280ec9a41f7003532826e?source=copy_link

​The July series focused on doing backprop by hand and understanding fundamentals deeply. You’ll get more out of it each time you rewatch.

​If you want to git gud at AI, come through.

Location
Level 13: Presidential / Mafia Room
9 Went