Subscribe
Sign in
Home
Notes
LLM Gallery
Support
LLMs From Scratch Book
Reasoning From Scratch Book
Archive
About
The Big LLM Architecture Comparison
From DeepSeek V3 to GLM-5: A Look At Modern LLM Architecture Design
Jul 19, 2025
•
Sebastian Raschka, PhD
2,043
101
180
Most Popular
View all
Understanding Reasoning LLMs
Feb 5, 2025
•
Sebastian Raschka, PhD
1,358
47
126
Understanding and Coding Self-Attention, Multi-Head Attention, Causal-Attention, and Cross-Attention in LLMs
Jan 14, 2024
525
43
20
Controlling Reasoning Effort in LLMs
Jul 18
•
Sebastian Raschka, PhD
395
45
32
Latest
Top
Discussions
GPT-6 Astra, Looped Transformers, and Hidden Reasoning
A Look at Recurrent Depth, Hidden Chains of Thought, and Recent Research on Looping Transformer Blocks
Sep 9
•
Sebastian Raschka, PhD
341
57
36
How Claude Watermarks AI-Generated Text
A 48-Minute Video Walkthrough of Token Sampling, Watermark Detection, and Removal
Aug 22
•
Sebastian Raschka, PhD
159
24
18
Building an AI Text Detector From Scratch
An End-to-End Project With Dataset Construction, Model Training, Local Deployment, and RLVR
Aug 15
•
Sebastian Raschka, PhD
45
6
5
Controlling Reasoning Effort in LLMs
How LLMs Learn Low-, Medium-, and High-Effort Reasoning Modes
Jul 18
•
Sebastian Raschka, PhD
395
45
32
Using Local Coding Agents
Using Open-Weight Models in Local Coding Harnesses as an Alternative to Claude Code and Codex Subscriptions
Jun 27
•
Sebastian Raschka, PhD
466
50
53
LLM Research Papers: The 2026 List (January to May)
A curated roundup of notable LLM research papers that came out this year
Jun 6
•
Sebastian Raschka, PhD
91
3
12
Recent Developments in LLM Architectures: KV Sharing, mHC, and Compressed Attention
From Gemma 4 to DeepSeek V4, How New Open-Weight LLMs Are Reducing Long-Context Costs
May 16
•
Sebastian Raschka, PhD
348
20
32
See all
Ahead of AI
Ahead of AI focuses on machine learning and AI research and is read by more than 200,000 researchers and practitioners who want to stay ahead in a rapidly evolving field.
Subscribe
Ahead of AI
Subscribe
About
Archive
Recommendations
Sitemap
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
