Fine-tuning pitfalls

Fine-tuning pitfalls

Hands-on workshop on LLM fine-tuning pitfalls

A practical workshop covering common failure modes in LLM fine-tuning, including issues with dataset quality, learning rate schedules, overfitting, catastrophic forgetting, and evaluation methodology. Participants work through concrete examples using open-source tooling to identify and correct these problems in realistic fine-tuning scenarios.

FailureMachine Learning
Maturity
Support
C4DT
Retired
Lab
Unknown
  • C4DT work
Status: Retired
Timeline: 2024/Q3 Fine-tuning pitfalls

Laboratory for Information and Inference Systems

Laboratory for Information and Inference Systems
Volkan Cevher

Prof. Volkan Cevher

At LIONS, we are concerned with optimized information extraction from signals or data volumes. We therefore develop mathematical theory and computational methods for information recovery from highly incomplete data.

This page was last edited on 2024-11-21.