Ahead of AI

Home
Books
Support
Archive
About
New
Top
Discussion
Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
Things I Learned From Hundreds of Experiments
 • 
Sebastian Raschka, PhD
17
Research Papers (October 2023)
A Potential Successor to RLHF for Efficient LLM Alignment and the Resurgence of CNNs
 • 
Sebastian Raschka, PhD
October 2023
AI and Open Source in 2023
The Highs and Lows: A Year in Review
 • 
Sebastian Raschka, PhD
11
Ahead of AI #12: LLM Business and Busyness
Discussing Recent Company Investments and AI Adoption, New Small Openly Available LLMs, and LoRA Research
 • 
Sebastian Raschka, PhD
17
September 2023
August 2023
The Missing Bits: Llama 2 Weights Have Changed
Due to the extensive length of the regular Ahead of AI #11: New Foundation Models article, I removed some interesting tidbits around the Llama 2 weights…
 • 
Sebastian Raschka, PhD
2
Ahead of AI #11: New Foundation Models
In this edition of the newsletter, we direct our attention to one of the most prominent highlights of the summer: the release of the Llama 2 base and…
 • 
Sebastian Raschka, PhD
14
Research Highlights in Three Sentences or Less (July-August 2023)
Every month is a busy month for LLM research. However, this month has been particularly interesting due to the release of new state-of-the-art base…
 • 
Sebastian Raschka, PhD
8
July 2023
Large Language Models and Nearest Neighbors
Instead of jumping on the latest trend of the week, I wanted to dive into a recent, fascinating application of nearest-neighbor methods in the context…
 • 
Sebastian Raschka, PhD
10
AI Research Highlights In 3 Sentences Or Less (June-July 2023)
In this article, I compiled and annotated 24 AI research highlights form June to July 2023. A lot of exciting developments are currently happening, once…
 • 
Sebastian Raschka, PhD
2
Ahead of AI #10: State of Computer Vision 2023
Large language model development (LLM) development is still happening at a rapid pace. At the same time, leaving AI regulation debates aside, LLM news…
 • 
Sebastian Raschka, PhD
8
© 2023 Sebastian Raschka
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing