micrograd

micrograd by Andrej Karpathy is a tiny scalar-valued automatic differentiation engine with a small neural network library built on top, written for teaching. In roughly a hundred lines it implements reverse-mode backpropagation over a dynamically constructed graph with a PyTorch-like API, enough to train small classifiers while keeping every operation inspectable. It is meant for learning how autograd works. Released under the MIT license.