Ahead of AI

Ahead of AI

The Big LLM Architecture Comparison
From DeepSeek-V3 to Kimi K2: A Look At Modern LLM Architecture Design
 • Sebastian Raschka, PhD
Categories of Inference-Time Scaling for Improved LLM Reasoning
And an Overview of Recent Inference-Scaling Papers
 • Sebastian Raschka, PhD
The State Of LLMs 2025: Progress, Problems, and Predictions
A 2025 review of large language models, from DeepSeek R1 and RLVR to inference-time scaling, benchmarks, architectures, and predictions for 2026.
 • Sebastian Raschka, PhD
LLM Research Papers: The 2025 List (July to December)
In June, I shared a bonus article with my curated and bookmarked research paper lists to the paid subscribers who make this Substack possible.
 • Sebastian Raschka, PhD
From DeepSeek V3 to V3.2: Architecture, Sparse Attention, and RL Updates
Understanding How DeepSeek's Flagship Open-Weight Models Evolved
 • Sebastian Raschka, PhD

Recent posts

View all
Beyond Standard LLMs
Linear Attention Hybrids, Text Diffusion, Code World Models, and Small Recursive Transformers
 • Sebastian Raschka, PhD
Understanding the 4 Main Approaches to LLM Evaluation (From Scratch)
Multiple-Choice Benchmarks, Verifiers, Leaderboards, and LLM Judges with Code Examples
 • Sebastian Raschka, PhD
Understanding and Implementing Qwen3 From Scratch
A Detailed Look at One of the Leading Open-Source LLMs
 • Sebastian Raschka, PhD
From GPT-2 to gpt-oss: Analyzing the Architectural Advances
And How They Stack Up Against Qwen3
 • Sebastian Raschka, PhD
LLM Research Papers: The 2025 List (January to June)
A topic-organized collection of 200+ LLM research papers from 2025
 • Sebastian Raschka, PhD
Understanding and Coding the KV Cache in LLMs from Scratch
KV caches are one of the most critical techniques for efficient inference in LLMs in production.
 • Sebastian Raschka, PhD
Coding LLMs from the Ground Up: A Complete Course
Why build LLMs from scratch? It's probably the best and most efficient way to learn how LLMs really work. Plus, many readers have told me they had a lot…
 • Sebastian Raschka, PhD
The State of Reinforcement Learning for LLM Reasoning
Understanding GRPO and New Insights from Reasoning Model Papers
 • Sebastian Raschka, PhD
First Look at Reasoning From Scratch: Chapter 1
Welcome to the next stage of large language models (LLMs): reasoning. LLMs have transformed how we process and generate text, but their success has been…
 • Sebastian Raschka, PhD
The State of LLM Reasoning Model Inference
Inference-Time Compute Scaling Methods to Improve Reasoning Models
 • Sebastian Raschka, PhD
Understanding Reasoning LLMs
Methods and Strategies for Building and Refining Reasoning Models
 • Sebastian Raschka, PhD
Noteworthy AI Research Papers of 2024 (Part Two)
Six influential AI papers from July to December
 • Sebastian Raschka, PhD
Subscribe to receive new in-depth research insights on AI and machine learning.
© 2026 Raschka AI Research (RAIR) Lab LLC · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture