This blog content follows from an amazing video of building Neural Network of **Andrej Karpathy.** It is basically a reading version of his video with more words and less code :), and with more detailed explanation and intuition of some concepts that he skipped.

https://www.youtube.com/watch?v=VMj-3S1tku0&list=LL&index=1&t=7585s

Derivative of function with 1 input

Derivative of function with multiple inputs (Partial Derivative)

Chain Rule

Backpropagation

Optional: Visualizing Neuron

Code: Manual Backpropagation

Code: Bug (Node used multiple times)

Code: Topological Sort

Code: Build Neural Network 🤓

Code: Neural Network in action

Code: Gradient Descent