Projects by Tag: distillation — Model Distillation Projects for Compression, Knowledge Transfer, and Efficient Inference
Discover projects tagged distillation that employ knowledge distillation, dataset distillation, and teacher-student training to deliver model compression, faster inference, and robustness across vision, NLP, and multimodal tasks. This curated list highlights practical implementations including transformer distillation for language models, convolutional distillation for computer vision, dataset distillation for efficient training, and quantization-aware pipelines, with long-tail insights on temperature scaling, loss weighting, intermediate feature matching, and deployment optimizations. Use filters to narrow results by architecture, dataset, task (classification, detection, language modeling), deployment target (edge, mobile, cloud), or license, and compare benchmarks like accuracy retention, latency, model size, and FLOPs to identify the best-fit projects. Explore code, papers, and reproducible experiments to replicate results or adapt state-of-the-art distillation techniques—filter, compare, and clone the most relevant projects now.
