When Transformers Sing: Adapting SpectralKD for Text-Based Knowledge Distillation
While working on my Knowledge Distillation problem for intent classification, I faced a puzzling roadblock. My setup involved a teacher ...
Read moreDetailsWhile working on my Knowledge Distillation problem for intent classification, I faced a puzzling roadblock. My setup involved a teacher ...
Read moreDetails