The process of further training a pre-trained model on a smaller, task-specific dataset to adapt it for particular use cases.
Teaching an AI that already knows a lot to be extra good at one special thing — like a dog that learns a new trick.
Taking an AI that's already been trained on general stuff and giving it extra training on specific topics so it becomes an expert.
The process of further training a pre-trained model on a smaller, task-specific dataset to adapt it for particular use cases.
Continued training of a pre-trained foundation model on domain-specific or task-specific data, often with modified learning rates, to specialize its capabilities while preserving general knowledge.
Parameter adaptation of a pre-trained model via gradient updates on a downstream objective — encompassing full fine-tuning, LoRA, prefix tuning, and RLHF, each navigating the plasticity-stability tradeoff differently.
Want to explore Fine-Tuning in depth?
Ask SeekBox and get answers from 7 AI engines at once.
Try it in SeekBox →