Fine-Tuning Small Language Models

Welcome! You will master hands-on techniques to adapt compact AI models for custom tasks, giving you powerful practical skills for your upcoming academic and personal projects. * **Preparing custom datasets** for optimal training * **Applying parameter-efficient techniques** like LoRA and QLoRA * **Training compact models** on consumer hardware * **Evaluating performance** of custom lightweight architectures

5 sections ยท 15 lessons

Course outline

Foundations

  1. What's an SLM?
  2. Small Language Models in Action
  3. Why Fine-Tune
  4. Fine-Tuning Alternatives
  5. Foundations

Data Preparation

  1. Dataset Design
  2. Data Formatting
  3. Data Preparation

Training Methods

  1. Full Fine-Tuning
  2. LoRA Basics
  3. QLoRA

Hands-On Training

  1. Tooling Setup
  2. Hyperparameters
  3. Monitoring Training

Evaluation & Deployment

  1. Model Evaluation
  2. Merging & Export
  3. Local Deployment

Start learning with Wondering