Neural-networks

Technical blog posts and working notes on AI systems, modeling, and production lessons.

Published on
August 22, 2023
Deep-Learning Batch-Normalization PyTorch
Batch Normalization: Accelerating Deep Network Training
Understanding Batch Normalization, one of the most important techniques for training deep neural networks, from theory to implementation.
Published on
July 15, 2023
Deep-Learning Optimizers PyTorch
Deep Learning Optimizers: A Comprehensive Guide to Training Neural Networks
Exploring the landscape of deep learning optimizers from SGD to Adam and beyond, understanding their mechanics and when to use each one.