Subscribe
Sign in
Home
Books
Support
Archive
About
New
Top
Discussion
Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
Things I Learned From Hundreds of Experiments
Nov 19
•
Sebastian Raschka, PhD
136
Share this post
Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
magazine.sebastianraschka.com
Copy link
Facebook
Email
Note
Other
17
Research Papers (October 2023)
A Potential Successor to RLHF for Efficient LLM Alignment and the Resurgence of CNNs
Nov 4
•
Sebastian Raschka, PhD
67
Share this post
Research Papers (October 2023)
magazine.sebastianraschka.com
Copy link
Facebook
Email
Note
Other
October 2023
AI and Open Source in 2023
The Highs and Lows: A Year in Review
Oct 23
•
Sebastian Raschka, PhD
93
Share this post
AI and Open Source in 2023
magazine.sebastianraschka.com
Copy link
Facebook
Email
Note
Other
11
Ahead of AI #12: LLM Business and Busyness
Discussing Recent Company Investments and AI Adoption, New Small Openly Available LLMs, and LoRA Research
Oct 8
•
Sebastian Raschka, PhD
69
Share this post
Ahead of AI #12: LLM Business and Busyness
magazine.sebastianraschka.com
Copy link
Facebook
Email
Note
Other
17
September 2023
Research Highlights in Three Sentences or Less (August-September 2023)
Another month, another round of interesting research papers ranging from large language modeling to computer vision. One recent focus is on refining…
Sep 23
•
Sebastian Raschka, PhD
54
Share this post
Research Highlights in Three Sentences or Less (August-September 2023)
magazine.sebastianraschka.com
Copy link
Facebook
Email
Note
Other
4
LLM Training: RLHF and Its Alternatives
I frequently reference a process called Reinforcement Learning with Human Feedback (RLHF) when discussing LLMs, whether in the research news or…
Sep 10
•
Sebastian Raschka, PhD
113
Share this post
LLM Training: RLHF and Its Alternatives
magazine.sebastianraschka.com
Copy link
Facebook
Email
Note
Other
4
August 2023
The Missing Bits: Llama 2 Weights Have Changed
Due to the extensive length of the regular Ahead of AI #11: New Foundation Models article, I removed some interesting tidbits around the Llama 2 weights…
Aug 27
•
Sebastian Raschka, PhD
5
Share this post
The Missing Bits: Llama 2 Weights Have Changed
magazine.sebastianraschka.com
Copy link
Facebook
Email
Note
Other
2
Ahead of AI #11: New Foundation Models
In this edition of the newsletter, we direct our attention to one of the most prominent highlights of the summer: the release of the Llama 2 base and…
Aug 26
•
Sebastian Raschka, PhD
105
Share this post
Ahead of AI #11: New Foundation Models
magazine.sebastianraschka.com
Copy link
Facebook
Email
Note
Other
14
Research Highlights in Three Sentences or Less (July-August 2023)
Every month is a busy month for LLM research. However, this month has been particularly interesting due to the release of new state-of-the-art base…
Aug 12
•
Sebastian Raschka, PhD
59
Share this post
Research Highlights in Three Sentences or Less (July-August 2023)
magazine.sebastianraschka.com
Copy link
Facebook
Email
Note
Other
8
July 2023
Large Language Models and Nearest Neighbors
Instead of jumping on the latest trend of the week, I wanted to dive into a recent, fascinating application of nearest-neighbor methods in the context…
Jul 30
•
Sebastian Raschka, PhD
85
Share this post
Large Language Models and Nearest Neighbors
magazine.sebastianraschka.com
Copy link
Facebook
Email
Note
Other
10
AI Research Highlights In 3 Sentences Or Less (June-July 2023)
In this article, I compiled and annotated 24 AI research highlights form June to July 2023. A lot of exciting developments are currently happening, once…
Jul 15
•
Sebastian Raschka, PhD
77
Share this post
AI Research Highlights In 3 Sentences Or Less (June-July 2023)
magazine.sebastianraschka.com
Copy link
Facebook
Email
Note
Other
2
Ahead of AI #10: State of Computer Vision 2023
Large language model development (LLM) development is still happening at a rapid pace. At the same time, leaving AI regulation debates aside, LLM news…
Jul 6
•
Sebastian Raschka, PhD
54
Share this post
Ahead of AI #10: State of Computer Vision 2023
magazine.sebastianraschka.com
Copy link
Facebook
Email
Note
Other
8
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts