In the last chapter (Part 12), we explored how language models can be adapted via fine-tuning.
We began by discussing the central question of when fine-tuning is actually worth doing. We studied the reasons to fine-tune and the reasons to avoid it.
After that, we moved to understanding PEFT techniques. In particular, we explored LoRA and QLoRA. We understood...