Understanding and Implementing Qwen3 From Scratch

A Detailed Look at One of the Leading Open-Source LLMs

Sep 6 • 

Sebastian Raschka, PhD

60

4

August 2025

From GPT-2 to gpt-oss: Analyzing the Architectural Advances

And How They Stack Up Against Qwen3

Aug 9 • 

Sebastian Raschka, PhD

562

45

July 2025

The Big LLM Architecture Comparison

From DeepSeek-V3 to Kimi K2: A Look At Modern LLM Architecture Design

Jul 19 • 

Sebastian Raschka, PhD

1,177

55

LLM Research Papers: The 2025 List (January to June)

A topic-organized collection of 200+ LLM research papers from 2025

Jul 1 • 

Sebastian Raschka, PhD

70

5

June 2025

Understanding and Coding the KV Cache in LLMs from Scratch

KV caches are one of the most critical techniques for efficient inference in LLMs in production.

Jun 17 • 

Sebastian Raschka, PhD

384

27

May 2025

Coding LLMs from the Ground Up: A Complete Course

Why build LLMs from scratch? It's probably the best and most efficient way to learn how LLMs really work. Plus, many readers have told me they had a lot…

May 10 • 

Sebastian Raschka, PhD

233

4

April 2025

The State of Reinforcement Learning for LLM Reasoning

Understanding GRPO and New Insights from Reasoning Model Papers

Apr 19 • 

Sebastian Raschka, PhD

432

31

March 2025

First Look at Reasoning From Scratch: Chapter 1

Welcome to the next stage of large language models (LLMs): reasoning. LLMs have transformed how we process and generate text, but their success has been…

Mar 29 • 

Sebastian Raschka, PhD

56

15

The State of LLM Reasoning Model Inference

Inference-Time Compute Scaling Methods to Improve Reasoning Models

Mar 8 • 

Sebastian Raschka, PhD

389

10

February 2025

Understanding Reasoning LLMs

Methods and Strategies for Building and Refining Reasoning Models

Feb 5 • 

Sebastian Raschka, PhD

1,096

40

January 2025

Noteworthy AI Research Papers of 2024 (Part Two)

Six influential AI papers from July to December

Jan 15 • 

Sebastian Raschka, PhD

172

10

December 2024

Noteworthy AI Research Papers of 2024 (Part One)

Six influential AI papers from January to June

Dec 31, 2024 • 

Sebastian Raschka, PhD

360

28