Ahead of AI

Ahead of AI

Home
Support
LLMs From Scratch Book
Archive
About
Most Popular
View all
Understanding Large Language Models
 • Sebastian Raschka, PhD
54
Understanding and Coding Self-Attention, Multi-Head Attention, Cross-Attention, and Causal-Attention in LLMs
41
Building LLMs from the Ground Up: A 3-hour Coding Workshop
 • Sebastian Raschka, PhD
15
Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
 • Sebastian Raschka, PhD
48

Recent posts

View all
First Look at Reasoning From Scratch: Chapter 1
Welcome to the next stage of large language models (LLMs): reasoning. LLMs have transformed how we process and generate text, but their success has been…
 • 
Sebastian Raschka, PhD
6
The State of LLM Reasoning Models
Part 1: Inference-Time Compute Scaling Methods
 • 
Sebastian Raschka, PhD
9
Noteworthy AI Research Papers of 2024 (Part Two)
Six influential AI papers from July to December
 • 
Sebastian Raschka, PhD
10
Noteworthy AI Research Papers of 2024 (Part One)
Six influential AI papers from January to June
 • 
Sebastian Raschka, PhD
28
LLM Research Papers: The 2024 List
A curated list of interesting LLM-related research papers from 2024, shared for those looking for something to read over the holidays.
 • 
Sebastian Raschka, PhD
28
Understanding Multimodal LLMs
An introduction to the main techniques and latest models
 • 
Sebastian Raschka, PhD
50
Building A GPT-Style LLM Classifier From Scratch
Finetuning a GPT Model for Spam Classification
 • 
Sebastian Raschka, PhD
12
Building LLMs from the Ground Up: A 3-hour Coding Workshop
If your weekend plans include catching up on AI developments and understanding Large Language Models (LLMs), I've prepared a 1-hour presentation on the…
 • 
Sebastian Raschka, PhD
15
New LLM Pre-training and Post-training Paradigms
A Look at How Moderns LLMs Are Trained
 • 
Sebastian Raschka, PhD
28
Instruction Pretraining LLMs
The Latest Research in Instruction Finetuning
 • 
Sebastian Raschka, PhD
17
Developing an LLM: Building, Training, Finetuning
A Deep Dive into the Lifecycle of LLM Development
 • 
Sebastian Raschka, PhD
18
LLM Research Insights: Instruction Masking and New LoRA Finetuning Experiments
Discussing the Latest Model Releases and AI Research in May 2024
 • 
Sebastian Raschka, PhD
9
Subscribe to receive new in-depth research insights on AI and machine learning.
© 2025 Sebastian Raschka
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture