Subscribe
Sign in
Home
Notes
Support
LLMs From Scratch Book
Reasoning From Scratch Book
Archive
About
The Big LLM Architecture Comparison
From DeepSeek-V3 to Kimi K2: A Look At Modern LLM Architecture Design
Jul 19
•
Sebastian Raschka, PhD
1,166
45
Most Popular
View all
Understanding Reasoning LLMs
Feb 5
•
Sebastian Raschka, PhD
1,093
40
Understanding and Coding Self-Attention, Multi-Head Attention, Causal-Attention, and Cross-Attention in LLMs
Jan 14, 2024
383
41
Understanding Large Language Models
Apr 16, 2023
•
Sebastian Raschka, PhD
921
53
From GPT-2 to gpt-oss: Analyzing the Architectural Advances
Aug 9
•
Sebastian Raschka, PhD
553
45
Recent posts
View all
Understanding and Implementing Qwen3 From Scratch
A Detailed Look at One of the Leading Open-Source LLMs
Sep 6
•
Sebastian Raschka, PhD
54
4
From GPT-2 to gpt-oss: Analyzing the Architectural Advances
And How They Stack Up Against Qwen3
Aug 9
•
Sebastian Raschka, PhD
553
45
LLM Research Papers: The 2025 List (January to June)
A topic-organized collection of 200+ LLM research papers from 2025
Jul 1
•
Sebastian Raschka, PhD
69
5
Understanding and Coding the KV Cache in LLMs from Scratch
KV caches are one of the most critical techniques for efficient inference in LLMs in production.
Jun 17
•
Sebastian Raschka, PhD
380
27
Coding LLMs from the Ground Up: A Complete Course
Why build LLMs from scratch? It's probably the best and most efficient way to learn how LLMs really work. Plus, many readers have told me they had a lot…
May 10
•
Sebastian Raschka, PhD
233
4
The State of Reinforcement Learning for LLM Reasoning
Understanding GRPO and New Insights from Reasoning Model Papers
Apr 19
•
Sebastian Raschka, PhD
431
31
First Look at Reasoning From Scratch: Chapter 1
Welcome to the next stage of large language models (LLMs): reasoning. LLMs have transformed how we process and generate text, but their success has been…
Mar 29
•
Sebastian Raschka, PhD
56
15
The State of LLM Reasoning Model Inference
Inference-Time Compute Scaling Methods to Improve Reasoning Models
Mar 8
•
Sebastian Raschka, PhD
389
10
Understanding Reasoning LLMs
Methods and Strategies for Building and Refining Reasoning Models
Feb 5
•
Sebastian Raschka, PhD
1,093
40
Noteworthy AI Research Papers of 2024 (Part Two)
Six influential AI papers from July to December
Jan 15
•
Sebastian Raschka, PhD
172
10
Noteworthy AI Research Papers of 2024 (Part One)
Six influential AI papers from January to June
Dec 31, 2024
•
Sebastian Raschka, PhD
360
28
LLM Research Papers: The 2024 List
A curated list of interesting LLM-related research papers from 2024, shared for those looking for something to read over the holidays.
Dec 8, 2024
•
Sebastian Raschka, PhD
296
28
See all
Subscribe to receive new in-depth research insights on AI and machine learning.
Subscribe
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
