Ahead of AI

Home
Books
Support
Archive
About
Understanding Large Language Models
A Cross-Section of the Most Relevant Literature To Get Up to Speed
 • 
Sebastian Raschka, PhD
27
Most Popular
View all
Understanding Encoder And Decoder LLMs
 • Sebastian Raschka, PhD
Finetuning Large Language Models
 • Sebastian Raschka, PhD
21
Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
 • Sebastian Raschka, PhD
17
New
Top
Community
Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
Things I Learned From Hundreds of Experiments
 • 
Sebastian Raschka, PhD
17
Research Papers (October 2023)
A Potential Successor to RLHF for Efficient LLM Alignment and the Resurgence of CNNs
 • 
Sebastian Raschka, PhD
AI and Open Source in 2023
The Highs and Lows: A Year in Review
 • 
Sebastian Raschka, PhD
11
Ahead of AI #12: LLM Business and Busyness
Discussing Recent Company Investments and AI Adoption, New Small Openly Available LLMs, and LoRA Research
 • 
Sebastian Raschka, PhD
17
Research Highlights in Three Sentences or Less (August-September 2023)
Another month, another round of interesting research papers ranging from large language modeling to computer vision. One recent focus is on refining…
 • 
Sebastian Raschka, PhD
4
LLM Training: RLHF and Its Alternatives
I frequently reference a process called Reinforcement Learning with Human Feedback (RLHF) when discussing LLMs, whether in the research news or…
 • 
Sebastian Raschka, PhD
4
The Missing Bits: Llama 2 Weights Have Changed
Due to the extensive length of the regular Ahead of AI #11: New Foundation Models article, I removed some interesting tidbits around the Llama 2 weights…
 • 
Sebastian Raschka, PhD
2
Ahead of AI
Ahead of AI
Ahead AI specializes in Machine Learning & AI research and is read by tens of thousands of researchers and practitioners who want to stay ahead in the ever-evolving field.
Recommendations
View all 12
Latent Space
Latent Space
swyx
M
Mindful Modeler
Christoph Molnar
AI Supremacy
AI Supremacy
Michael Spencer
Data Machina
Data Machina
Carlos
Artificial Intelligence Made Simple
Artificial Intelligence Made Simple
Devansh
© 2023 Sebastian Raschka
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing