• paper https://openaccess.thecvf.com/content_CVPR_2019/papers/Park_Relational_Knowledge_Distillation_CVPR_2019_paper.pdf
• code https://github.com/lenscloth/RKD

Relational KD vs Individual KD (conventional KD)

Results on Metric Learning

1. Distillation to smaller networks

• Figure2

2. Comparison with state-of-the art methods

Qualitative Results on Metric Learning