Subscribe
Sign in
Home
🧁 Articles
⚡️ LLM Inference
⚙️ GPU essentials
📉 LLM training
🤝 Sponsor
📚 Tech guides
Leaderboard
About
GPU essentials
How to Read GPU Specs
A simple and jargon-free guide to reading GPU specs for LLM training and inference.
Sep 4
•
Dr. Ashish Bamania
20
5
9 GPU Concepts Every AI Engineer Should Know
A simple and practical guide to GPU internals that AI engineers actually need.
Aug 27
•
Dr. Ashish Bamania
53
6
Arithmetic Intensity, Simply Explained
A no-jargon breakdown of Arithmetic Intensity and the Roofline model, and how they are used to optimize LLM inference.
Jul 6
•
Dr. Ashish Bamania
7
2
NVIDIA GPU Ecosystem, Simply Explained
A guide to NVIDIA GPU architecture, interconnects, and scaling in plain English.
Jun 30
•
Dr. Ashish Bamania
83
7
13
A hardware-level tour of how LLMs generate text
Understand what actually happens on the CPU and GPU when an LLM turns your prompt into text.
Jun 22
•
Dr. Ashish Bamania
205
4
25
Distributed Training of Llama, Explained Simply
A short and simple lesson on the techniques used to train LLMs like Meta Llama on massive GPU clusters.
Jun 5
•
Dr. Ashish Bamania
23
2
Learn to train a deep learning model on multiple GPUs with Distributed PyTorch
Part 2: Train a CNN on NVIDIA GPUs with PyTorch's Distributed Data Parallel (DDP)
Mar 8
•
Dr. Ashish Bamania
8
1
Learn to train deep learning models on multiple GPUs
Part 1: Understand Distributed Data Parallel in depth, visually
Feb 26
•
Dr. Ashish Bamania
4
1
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
