Ahead of AI

Home
Sebastian's Books
Archive
About
New
Top
Discussion
About LayerNorm Variants in the Original Transformer Paper, and Some Other Interesting Historical Tidbits About LLMs
A few months ago, I shared the article, Understanding Large Language Models: A Cross-Section of the Most Relevant Literature To Get Up to Speed, and the…
 • 
Sebastian Raschka
2
Finetuning LLMs Efficiently with Adapters
Why Finetuning LLMs? Large language models (LLMs) like BERT, GPT-3, GPT-4, LLaMA, and others are trained on a large corpus of data and have general…
 • 
Sebastian Raschka
AI Research Highlights In 3 Sentences Or Less (April-May 2023)
This article is a compilation of 22 AI research highlights, handpicked and summarized. A lot of exciting developments are currently happening in the…
 • 
Sebastian Raschka
6
Ahead of AI #8: The Latest Open Source LLMs and Datasets
The theme of this month's issue is to organize the almost overwhelming number of large language models (LLM) projects and datasets shared in the last…
 • 
Sebastian Raschka
4
April 2023
Understanding Parameter-Efficient LLM Finetuning: Prompt Tuning And Prefix Tuning
Last week, I shared an overview of different Large Language Model (LLM) finetuning techniques. In a series of short articles, I am planning to discuss a…
 • 
Sebastian Raschka
5
Finetuning Large Language Models
An introduction to the core ideas and approaches
 • 
Sebastian Raschka
19
Understanding Large Language Models
A Cross-Section of the Most Relevant Literature To Get Up to Speed
 • 
Sebastian Raschka
22
Ahead of AI #7: Large Language Models 3.0
Large Language Models 1.0. It's been about half a decade since we saw the emergence of the original transformer model, BERT, BLOOM, GPT 1 to 3, and many…
 • 
Sebastian Raschka
4
March 2023
February 2023
January 2023
December 2022
Ahead of AI #3: A(I)nnouncements
Launching large language models, educational material, and open source software
 • 
Sebastian Raschka
2
© 2023 Sebastian Raschka
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing