benedikt.phd
Check it out: benedikt.phd/bsky-follow-...
Check it out: benedikt.phd/bsky-follow-...
Check it out: benedikt.phd/bsky-follow-...
Knowledge distillation can work in cross-task settings and even with a randomly initialised teacher! Our inverted projection decomposes into knowledge transfer and spectral regularisation, enabling teacher-free distillation with improvements on ImageNet-1K at no extra cost
Knowledge distillation can work in cross-task settings and even with a randomly initialised teacher! Our inverted projection decomposes into knowledge transfer and spectral regularisation, enabling teacher-free distillation with improvements on ImageNet-1K at no extra cost
@msftresearch.bsky.social
#ML #AI
@msftresearch.bsky.social
#ML #AI
I'm Benedikt, PhD at Imperial, and I work on machine learning and computer vision 🤖🧠
Looking forward to connecting with other ML researchers and sharing insights!
I'm Benedikt, PhD at Imperial, and I work on machine learning and computer vision 🤖🧠
Looking forward to connecting with other ML researchers and sharing insights!