Advancements in Knowledge Distillation: Towards New Horizons ... - 9783031320972

Advancements in Knowledge Distillation: Towards New Horizons of Intelligent SystemsAuthor(s): Witold Pedrycz, Shyi-Ming Chen\nFormat: Paperback\nPublisher: Springer International Publishing AG, Switzerland\nImprint: Springer International Publishing AG\nISBN-13: 9783031320972, 978-3031320972\nSynopsis\nThe book provides a timely coverage of the paradigm of knowledge distillationan efficient way ofmodel compression. Knowledge distillation is positioned in a general setting of transfer learning, which effectively learns a lightweight student model from a large teacher model. The book covers a variety of training schemes, teacherstudent architectures, and distillation algorithms. The book covers a wealth of topics including recent developments in vision and language learning, relational architectures, multi-task learning, and representative applications to image processing, computer vision, edge intelligence, and autonomous systems. The book is of relevance to a broad audience including.