Ahead of AI | Sebastian Raschka, PhD | Substack

New LLM Pre-training and Post-training Paradigms

A Look at How Moderns LLMs Are Trained

Aug 17 •

Sebastian Raschka, PhD

Most Popular

Understanding Large Language Models

Apr 16, 2023 • Sebastian Raschka, PhD

Building LLMs from the Ground Up: A 3-hour Coding Workshop

Aug 31 • Sebastian Raschka, PhD

Understanding and Coding Self-Attention, Multi-Head Attention, Cross-Attention, and Causal-Attention in LLMs

Jan 14

Ten Noteworthy AI Research Papers of 2023

Dec 30, 2023 • Sebastian Raschka, PhD

Recent posts

Building A GPT-Style LLM Classifier From Scratch

Finetuning a GPT Model for Spam Classification

Sep 21 •

Sebastian Raschka, PhD

Building LLMs from the Ground Up: A 3-hour Coding Workshop

If your weekend plans include catching up on AI developments and understanding Large Language Models (LLMs), I've prepared a 1-hour presentation on the…

Aug 31 •

Sebastian Raschka, PhD

Instruction Pretraining LLMs

The Latest Research in Instruction Finetuning

Jul 20 •

Sebastian Raschka, PhD

Developing an LLM: Building, Training, Finetuning

A Deep Dive into the Lifecycle of LLM Development

Jun 8 •

Sebastian Raschka, PhD

LLM Research Insights: Instruction Masking and New LoRA Finetuning Experiments

Discussing the Latest Model Releases and AI Research in May 2024

Jun 2 •

Sebastian Raschka, PhD

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts