Yeda AI Knowledge Base
Fine-Tuning
When to adapt a model instead of prompting it, and how to do it without burning a GPU budget.
Tip #043
Freeze the Model, Train the Adapter: How LoRA and QLoRA Cut Fine-Tuning Memory
LoRA freezes a base model’s weights and trains two small adapter matrices instead — here’s why that slashes GPU memory for fine-tuning without giving up much quality, plus how QLoRA pushes it further.
Tip #044Garbage Format In, Garbage Answers Out: Matching the Chat Template Before You Fine-Tune
A fine-tune that answers with broken text and stray tokens usually isn’t a data problem — it’s a chat-template mismatch. Here’s what a chat template is and how to apply the right one before training.
Tip #045A Model That Memorizes Isn’t Smart: Watching the Loss Curve to Stop Overfitting
Train a fine-tune for too many epochs and it stops generalizing and starts reciting your training data. Here’s how to read the loss curve and cap epochs before that happens.