Notes - Neural Networks: Zero to Hero

Andrej's GitHub Repository
Andrej's YouTube
Eureka Labs Discord

This GitHub repository contains Jupyter Notebooks and Markdown files with detailed notes on Andrej Karpathy's tutorial series "Neural Networks: Zero to Hero", his talks and general audience videos. These notes aim to provide an additional overview and documentation of the concepts and techniques covered in the videos.

Zero to Hero Tutorial Series

Video	Notes
	N001 - Building Micrograd
	N002 - Makemore 1
	N003 - Makemore 2 - MLP
	N004 - Makemore 3 - Activations, BatchNorm
	N005 - Makemore 4 - Becoming a Backprop Ninja
	N006 - Makemore 5 - WaveNet
	N007 - GPT From Scratch
	N008 - GPT Tokenizer
	N009 - Reproducing GPT-2

General

Video	Notes
	G001 - Deep Dive into LLMs like ChatGPT
	G002 - How I Use LLMs

Talks

Video	Notes
	T001 - State of GPT
	T001 - Intro to LLMs - Director's Cut

Getting Started

1. Clone this repository to your local machine using the following command:

git clone https://github.com/MK2112/nn-zero-to-hero-notes.git

2. Navigate to the repository, make sure to run pip install -r requirements.txt.
3. Launch Jupyter Notebook by running the command:

jupyter notebook

4. Within Jupyter, navigate to the repository and open the desired notebook.

Contributions

Contributions to this repository are welcome and encouraged. If you find any errors, have suggestions for improvements, or want to add to the materials, please submit a pull request.

Acknowledgments

Thank you Andrej Karpathy for creating and sharing the "Neural Networks: Zero to Hero" tutorial series, your talks and general audience videos. Your dedication and expertise have made this resource possible. Find more of Andrej's work on his GitHub and 𝕏/Twitter.

License

This repository is licensed under the MIT License. Please attribute the original content to Andrej Karpathy and provide links to the tutorial series, the videos and this repo.