Category K: Model Distillation

Compress large models into smaller, faster versions.

Recipes

RecipeDescriptionStatus
Knowledge TransferTeacher-student trainingVerified
Layer MatchingMatch intermediate layersVerified
Pruning-AwareDistill with pruningVerified
Quantization-AwareDistill for quantizationVerified