AI space.

I write about AI, I focus on Gen AI, NLP, Diffusion Models.

LLM From Scratch: Building TinyGPT that works

Transformer Components, Variants, Implementation Details

47 min read · October 05, 2025

2025 · dl, lecture-3 · cs336
Gradient-Based Optimization: Theory, Practice, and Evolution

sgd, momentum, adagrad, adam, and beyond

26 min read · August 24, 2025

2025 · dl-basics
Backpropagation: From Intuition to FLOPs

gradient calculation, flow and FLOPs

8 min read · July 24, 2025

2025 · dl-basics, lecture-1 · cs336
DL Under the Hood: Tensors, Views, and FLOPs

A deep dive into tensors, their storage, views, and compute in PyTorch.

11 min read · July 14, 2025

2025 · dl-basics, lecture-2 · cs336
How Computers Store Data in Memory: Brief Intro

fp32, fp16, and more

10 min read · July 01, 2025

2025 · pre-dl, lecture-1 · cs336