Beyond Standard LLMs

Linear Attention Hybrids, Text Diffusion, Code World Models, and Small Recursive Transformers

Nov 4 • 

Sebastian Raschka, PhD

287

20

29

October 2025

Understanding the 4 Main Approaches to LLM Evaluation (From Scratch)

Multiple-Choice Benchmarks, Verifiers, Leaderboards, and LLM Judges with Code Examples

Oct 5 • 

Sebastian Raschka, PhD

320

25

30

September 2025

Understanding and Implementing Qwen3 From Scratch

A Detailed Look at One of the Leading Open-Source LLMs

Sep 6 • 

Sebastian Raschka, PhD

99

4

10

August 2025

From GPT-2 to gpt-oss: Analyzing the Architectural Advances

And How They Stack Up Against Qwen3

Aug 9 • 

Sebastian Raschka, PhD

601

46

54

July 2025

The Big LLM Architecture Comparison

From DeepSeek-V3 to Kimi K2: A Look At Modern LLM Architecture Design

Jul 19 • 

Sebastian Raschka, PhD

1,415

68

131

LLM Research Papers: The 2025 List (January to June)

A topic-organized collection of 200+ LLM research papers from 2025

Jul 1 • 

Sebastian Raschka, PhD

83

5

9

June 2025

Understanding and Coding the KV Cache in LLMs from Scratch

KV caches are one of the most critical techniques for efficient inference in LLMs in production.

Jun 17 • 

Sebastian Raschka, PhD

412

32

33

May 2025

Coding LLMs from the Ground Up: A Complete Course

Why build LLMs from scratch? It's probably the best and most efficient way to learn how LLMs really work. Plus, many readers have told me they had a lot…

May 10 • 

Sebastian Raschka, PhD

241

4

18

April 2025

The State of Reinforcement Learning for LLM Reasoning

Understanding GRPO and New Insights from Reasoning Model Papers

Apr 19 • 

Sebastian Raschka, PhD

446

31

40

March 2025

First Look at Reasoning From Scratch: Chapter 1

Welcome to the next stage of large language models (LLMs): reasoning. LLMs have transformed how we process and generate text, but their success has been…

Mar 29 • 

Sebastian Raschka, PhD

61

15

8

The State of LLM Reasoning Model Inference

Inference-Time Compute Scaling Methods to Improve Reasoning Models

Mar 8 • 

Sebastian Raschka, PhD

398

10

32

February 2025

Understanding Reasoning LLMs

Methods and Strategies for Building and Refining Reasoning Models

Feb 5 • 

Sebastian Raschka, PhD

1,156

41

107