Nick Stracke
rmsnorm.bsky.social
Nick Stracke
@rmsnorm.bsky.social
PhD Student at Ommer Lab (Stable Diffusion)
Trying to understand motion...

🌐 https://nickstracke.dev
And thanks for the kind words ! :)
December 9, 2024 at 11:29 AM
It was due to a compute constraint at that time. We will update it with numbers run on the complete test set once we release a new version of the paper.
December 9, 2024 at 11:29 AM
We make code and cleaned 🧹 weights available for SD 1.5 and SD 2.1.

Have a look now!
📝 Paper: compvis.github.io/cleandift/st...
💻 Code: github.com/CompVis/clea...
🤗 Hugging Face: huggingface.co/CompVis/clea...
December 4, 2024 at 11:31 PM
We show you can, with just 30 minutes of task-agnostic finetuning on a single GPU. 🤯

No noise. Better features. Better performance. Across many tasks.

And no timestep searching headaches! 👇
December 4, 2024 at 11:31 PM
They need noisy images as input - and the right noise level for each task.
So we have to find the right timestep for every downstream task? 🤯

What if you could ditch all of that? 👇
December 4, 2024 at 11:31 PM
This work was co-led by @stefanabaumann.bsky.social and @koljabauer.bsky.social.

✨ Diffusion models are amazing at learning world representations. Their features power many tasks:
• Semantic correspondence
• Depth estimation
• Semantic segmentation
… and more!

But here’s the catch ⚡️👇
December 4, 2024 at 11:31 PM