Ahead of AI

Share this post

Large Language Models and Nearest Neighbors

magazine.sebastianraschka.com

Large Language Models and Nearest Neighbors

Sebastian Raschka, PhD
Jul 30, 2023
∙ Paid
85
Share this post

Large Language Models and Nearest Neighbors

magazine.sebastianraschka.com
10
Share

Instead of jumping on the latest trend of the week, I wanted to dive into a recent, fascinating application of nearest-neighbor methods in the context of large language models (LLMs) that made big waves in July.

You may know that I like simple yet elegant and baselines, but I also found this method quite refreshing given that most of the current research is about scaling already massive LLMs. While they may not scale to all kinds of problems where LLMs currently excel, seemingly simple methods such as nearest neighbor algorithms have a certain beauty to them. It also shows that there are still many opportunities to innovate and make significant contributions based on foundational or "classic" techniques.

Ahead of AI is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.

Nearest Neighbors in a Nutshell

Nearest neighbor methods are one of the fundamental methods in data mining, pattern recognition, and machine learning. They…

This post is for paid subscribers

Already a paid subscriber? Sign in
© 2023 Sebastian Raschka
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing