8+ hour, 19+ min ago  (190+ words) The Sequence The Sequence Knowledge #890: A Brief History of Model Distillation The papers and techniques that laid out the ground work to evolve distillation to this level. The story most people tell about knowledge distillation starts in 2015, with Geoffrey Hinton,…...