Ahead of AI

Home
Sebastian's Books
Archive
About
Understanding Large Language Models
A Cross-Section of the Most Relevant Literature To Get Up to Speed
 • 
Sebastian Raschka
22
Most Popular
View all
Finetuning Large Language Models
 • Sebastian Raschka
19
Finetuning LLMs Efficiently with Adapters
 • Sebastian Raschka
About LayerNorm Variants in the Original Transformer Paper, and Some Other Interesting Historical Tidbits About LLMs
 • Sebastian Raschka
2
New
Top
Community
About LayerNorm Variants in the Original Transformer Paper, and Some Other Interesting Historical Tidbits About LLMs
A few months ago, I shared the article, Understanding Large Language Models: A Cross-Section of the Most Relevant Literature To Get Up to Speed, and the…
 • 
Sebastian Raschka
2
Finetuning LLMs Efficiently with Adapters
Why Finetuning LLMs? Large language models (LLMs) like BERT, GPT-3, GPT-4, LLaMA, and others are trained on a large corpus of data and have general…
 • 
Sebastian Raschka
AI Research Highlights In 3 Sentences Or Less (April-May 2023)
This article is a compilation of 22 AI research highlights, handpicked and summarized. A lot of exciting developments are currently happening in the…
 • 
Sebastian Raschka
6
Ahead of AI #8: The Latest Open Source LLMs and Datasets
The theme of this month's issue is to organize the almost overwhelming number of large language models (LLM) projects and datasets shared in the last…
 • 
Sebastian Raschka
4
Understanding Parameter-Efficient LLM Finetuning: Prompt Tuning And Prefix Tuning
Last week, I shared an overview of different Large Language Model (LLM) finetuning techniques. In a series of short articles, I am planning to discuss a…
 • 
Sebastian Raschka
5
Finetuning Large Language Models
An introduction to the core ideas and approaches
 • 
Sebastian Raschka
19
Ahead of AI #7: Large Language Models 3.0
Large Language Models 1.0. It's been about half a decade since we saw the emergence of the original transformer model, BERT, BLOOM, GPT 1 to 3, and many…
 • 
Sebastian Raschka
4
Ahead of AI
Ahead of AI
Ahead AI specializes in Machine Learning & AI research and is read by more than 52,000 researchers and practitioners (across platforms) who want to stay ahead in the ever-evolving field.
Recommendations
View all 10
AI Supremacy
AI Supremacy Michael Spencer
M
Mindful ModelerChristoph Molnar
The Palindrome
The PalindromeTivadar Danka
Deep (Learning) Focus
Deep (Learning) FocusCameron R. Wolfe
The Gradient
The GradientThe Gradient
© 2023 Sebastian Raschka
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing