Ahead of AI

Ahead of AI

Home
Notes
Support
LLMs From Scratch Book
Archive
About
Most Popular
View all
Understanding and Coding Self-Attention, Multi-Head Attention, Causal-Attention, and Cross-Attention in LLMs
41
Understanding Large Language Models
 • Sebastian Raschka, PhD
54
Building LLMs from the Ground Up: A 3-hour Coding Workshop
 • Sebastian Raschka, PhD
16
Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
 • Sebastian Raschka, PhD
48

Recent posts

View all
Coding LLMs from the Ground Up: A Complete Course
Why build LLMs from scratch? It's probably the best and most efficient way to learn how LLMs really work. Plus, many readers have told me they had a lot…
 • 
Sebastian Raschka, PhD
1
The State of Reinforcement Learning for LLM Reasoning
Understanding GRPO and New Insights from Reasoning Model Papers
 • 
Sebastian Raschka, PhD
27
First Look at Reasoning From Scratch: Chapter 1
Welcome to the next stage of large language models (LLMs): reasoning. LLMs have transformed how we process and generate text, but their success has been…
 • 
Sebastian Raschka, PhD
12
The State of LLM Reasoning Model Inference
Inference-Time Compute Scaling Methods to Improve Reasoning Models
 • 
Sebastian Raschka, PhD
9
Noteworthy AI Research Papers of 2024 (Part Two)
Six influential AI papers from July to December
 • 
Sebastian Raschka, PhD
10
Noteworthy AI Research Papers of 2024 (Part One)
Six influential AI papers from January to June
 • 
Sebastian Raschka, PhD
28
LLM Research Papers: The 2024 List
A curated list of interesting LLM-related research papers from 2024, shared for those looking for something to read over the holidays.
 • 
Sebastian Raschka, PhD
28
Understanding Multimodal LLMs
An introduction to the main techniques and latest models
 • 
Sebastian Raschka, PhD
51
Building A GPT-Style LLM Classifier From Scratch
Finetuning a GPT Model for Spam Classification
 • 
Sebastian Raschka, PhD
12
Building LLMs from the Ground Up: A 3-hour Coding Workshop
If your weekend plans include catching up on AI developments and understanding Large Language Models (LLMs), I've prepared a 1-hour presentation on the…
 • 
Sebastian Raschka, PhD
16
New LLM Pre-training and Post-training Paradigms
A Look at How Moderns LLMs Are Trained
 • 
Sebastian Raschka, PhD
28
Instruction Pretraining LLMs
The Latest Research in Instruction Finetuning
 • 
Sebastian Raschka, PhD
17
Subscribe to receive new in-depth research insights on AI and machine learning.
© 2025 Raschka AI Research (RAIR) Lab LLC
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture