Understanding Parameter-Efficient LLM Finetuning: Prompt Tuning And Prefix Tuning
magazine.sebastianraschka.com
Last week, I shared an overview of different Large Language Model (LLM) finetuning techniques. In a series of short articles, I am planning to discuss a selection of the most relevant techniques one by one. Let's start with a selection of parameter-efficient finetuning
Thank you for a great explanation. I think the "intuition" behind some LLM finetuning methods is applicable to non-LLM models (e.g. ResNet), do you think we can use these techniques to make a "better" finetuned non-LLM models?
Thank you for a great explanation. I think the "intuition" behind some LLM finetuning methods is applicable to non-LLM models (e.g. ResNet), do you think we can use these techniques to make a "better" finetuned non-LLM models?
I'm not sure I understand prompt tuning. Do you recommend any resources that I can use to read about it?