Archive - Ahead of AI

From GPT-2 to gpt-oss: Analyzing the Architectural Advances

And How They Stack Up Against Qwen3

Aug 9 •

Sebastian Raschka, PhD

July 2025

The Big LLM Architecture Comparison

From DeepSeek-V3 to Kimi K2: A Look At Modern LLM Architecture Design

Jul 19 •

Sebastian Raschka, PhD

LLM Research Papers: The 2025 List (January to June)

A topic-organized collection of 200+ LLM research papers from 2025

Jul 1 •

Sebastian Raschka, PhD

June 2025

Understanding and Coding the KV Cache in LLMs from Scratch

KV caches are one of the most critical techniques for efficient inference in LLMs in production.

Jun 17 •

Sebastian Raschka, PhD

May 2025

Coding LLMs from the Ground Up: A Complete Course

Why build LLMs from scratch? It's probably the best and most efficient way to learn how LLMs really work. Plus, many readers have told me they had a lot…

May 10 •

Sebastian Raschka, PhD

April 2025

The State of Reinforcement Learning for LLM Reasoning

Understanding GRPO and New Insights from Reasoning Model Papers

Apr 19 •

Sebastian Raschka, PhD

March 2025

First Look at Reasoning From Scratch: Chapter 1

Welcome to the next stage of large language models (LLMs): reasoning. LLMs have transformed how we process and generate text, but their success has been…

Mar 29 •

Sebastian Raschka, PhD

The State of LLM Reasoning Model Inference

Inference-Time Compute Scaling Methods to Improve Reasoning Models

Mar 8 •

Sebastian Raschka, PhD

February 2025

Understanding Reasoning LLMs

Methods and Strategies for Building and Refining Reasoning Models

Feb 5 •

Sebastian Raschka, PhD

January 2025

Noteworthy AI Research Papers of 2024 (Part Two)

Six influential AI papers from July to December

Jan 15 •

Sebastian Raschka, PhD

December 2024

Noteworthy AI Research Papers of 2024 (Part One)

Six influential AI papers from January to June

Dec 31, 2024 •

Sebastian Raschka, PhD

LLM Research Papers: The 2024 List

A curated list of interesting LLM-related research papers from 2024, shared for those looking for something to read over the holidays.

Dec 8, 2024 •

Sebastian Raschka, PhD

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts