Subscribe
Sign in
Home
Sebastian's Books
Archive
About
New
Top
Discussion
About LayerNorm Variants in the Original Transformer Paper, and Some Other Interesting Historical Tidbits About LLMs
A few months ago, I shared the article, Understanding Large Language Models: A Cross-Section of the Most Relevant Literature To Get Up to Speed, and the…
May 24
•
Sebastian Raschka
53
2
Share this post
About LayerNorm Variants in the Original Transformer Paper, and Some Other Interesting Historical Tidbits About LLMs
magazine.sebastianraschka.com
Copy link
Facebook
Email
Notes
Other
Finetuning LLMs Efficiently with Adapters
Why Finetuning LLMs? Large language models (LLMs) like BERT, GPT-3, GPT-4, LLaMA, and others are trained on a large corpus of data and have general…
May 20
•
Sebastian Raschka
60
Share this post
Finetuning LLMs Efficiently with Adapters
magazine.sebastianraschka.com
Copy link
Facebook
Email
Notes
Other
AI Research Highlights In 3 Sentences Or Less (April-May 2023)
This article is a compilation of 22 AI research highlights, handpicked and summarized. A lot of exciting developments are currently happening in the…
May 13
•
Sebastian Raschka
67
6
Share this post
AI Research Highlights In 3 Sentences Or Less (April-May 2023)
magazine.sebastianraschka.com
Copy link
Facebook
Email
Notes
Other
Ahead of AI #8: The Latest Open Source LLMs and Datasets
The theme of this month's issue is to organize the almost overwhelming number of large language models (LLM) projects and datasets shared in the last…
May 6
•
Sebastian Raschka
60
4
Share this post
Ahead of AI #8: The Latest Open Source LLMs and Datasets
magazine.sebastianraschka.com
Copy link
Facebook
Email
Notes
Other
April 2023
Understanding Parameter-Efficient LLM Finetuning: Prompt Tuning And Prefix Tuning
Last week, I shared an overview of different Large Language Model (LLM) finetuning techniques. In a series of short articles, I am planning to discuss a…
Apr 30
•
Sebastian Raschka
61
5
Share this post
Understanding Parameter-Efficient LLM Finetuning: Prompt Tuning And Prefix Tuning
magazine.sebastianraschka.com
Copy link
Facebook
Email
Notes
Other
Finetuning Large Language Models
An introduction to the core ideas and approaches
Apr 22
•
Sebastian Raschka
168
19
Share this post
Finetuning Large Language Models
magazine.sebastianraschka.com
Copy link
Facebook
Email
Notes
Other
Understanding Large Language Models
A Cross-Section of the Most Relevant Literature To Get Up to Speed
Apr 16
•
Sebastian Raschka
451
22
Share this post
Understanding Large Language Models
magazine.sebastianraschka.com
Copy link
Facebook
Email
Notes
Other
Ahead of AI #7: Large Language Models 3.0
Large Language Models 1.0. It's been about half a decade since we saw the emergence of the original transformer model, BERT, BLOOM, GPT 1 to 3, and many…
Apr 4
•
Sebastian Raschka
52
4
Share this post
Ahead of AI #7: Large Language Models 3.0
magazine.sebastianraschka.com
Copy link
Facebook
Email
Notes
Other
March 2023
Ahead of AI #6: TrAIn Differently
This month, deep learning and AI research efforts have been very focused on new or different training paradigms for transformers. The first section of…
Mar 7
•
Sebastian Raschka
33
3
Share this post
Ahead of AI #6: TrAIn Differently
magazine.sebastianraschka.com
Copy link
Facebook
Email
Notes
Other
February 2023
Ahead of AI #5: RevAIval of Ideas
I hope you had a successful start to the new year, as did AI and deep learning research. In this edition of Ahead of AI #5, I wanted to showcase recent…
Feb 6
•
Sebastian Raschka
23
6
Share this post
Ahead of AI #5: RevAIval of Ideas
magazine.sebastianraschka.com
Copy link
Facebook
Email
Notes
Other
January 2023
Ahead of AI #4: A Big Year For AI
Happy New Year! I'm thrilled to see that Ahead of AI has gained more than 20,000 subscribers after only 3 issues. This is a great motivator to keep…
Jan 2
•
Sebastian Raschka
39
7
Share this post
Ahead of AI #4: A Big Year For AI
magazine.sebastianraschka.com
Copy link
Facebook
Email
Notes
Other
December 2022
Ahead of AI #3: A(I)nnouncements
Launching large language models, educational material, and open source software
Dec 7, 2022
•
Sebastian Raschka
22
2
Share this post
Ahead of AI #3: A(I)nnouncements
magazine.sebastianraschka.com
Copy link
Facebook
Email
Notes
Other
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts