Ahead of AI

Home
Books
Support
Archive
About
Understanding Large Language Models
A Cross-Section of the Most Relevant Literature To Get Up to Speed
 • 
Sebastian Raschka, PhD
27
Most Popular
View all
Understanding Encoder And Decoder LLMs
 • Sebastian Raschka, PhD
Finetuning Large Language Models
 • Sebastian Raschka, PhD
21
Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
 • Sebastian Raschka, PhD
17
New
Top
Community
Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
Things I Learned From Hundreds of Experiments
 • 
Sebastian Raschka, PhD
17
Research Papers (October 2023)
A Potential Successor to RLHF for Efficient LLM Alignment and the Resurgence of CNNs
 • 
Sebastian Raschka, PhD
AI and Open Source in 2023
The Highs and Lows: A Year in Review
 • 
Sebastian Raschka, PhD
11
Ahead of AI #12: LLM Business and Busyness
Discussing Recent Company Investments and AI Adoption, New Small Openly Available LLMs, and LoRA Research
 • 
Sebastian Raschka, PhD
17
Research Highlights in Three Sentences or Less (August-September 2023)
Another month, another round of interesting research papers ranging from large language modeling to computer vision. One recent focus is on refining…
 • 
Sebastian Raschka, PhD
4
LLM Training: RLHF and Its Alternatives
I frequently reference a process called Reinforcement Learning with Human Feedback (RLHF) when discussing LLMs, whether in the research news or…
 • 
Sebastian Raschka, PhD
4
The Missing Bits: Llama 2 Weights Have Changed
Due to the extensive length of the regular Ahead of AI #11: New Foundation Models article, I removed some interesting tidbits around the Llama 2 weights…
 • 
Sebastian Raschka, PhD
2
Ahead of AI
Ahead of AI
Ahead AI specializes in Machine Learning & AI research and is read by tens of thousands of researchers and practitioners who want to stay ahead in the ever-evolving field.
Recommendations
View all 12
The Gradient
The Gradient
The Gradient
NLP News
NLP News
Sebastian Ruder
Artificial Intelligence Made Simple
Artificial Intelligence Made Simple
Devansh
Deep (Learning) Focus
Deep (Learning) Focus
Cameron R. Wolfe, Ph.D.
M
Mindful Modeler
Christoph Molnar
© 2023 Sebastian Raschka
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing