www.iolojones.co.uk
In our #NeurIPS2025 paper "Less is More: Local Intrinsic Dimensions of Contextual Language Models," we study how the local intrinsic dimension (LID) of embeddings changes during training and fine-tuning.
#research
🧵1/n
In our #NeurIPS2025 paper "Less is More: Local Intrinsic Dimensions of Contextual Language Models," we study how the local intrinsic dimension (LID) of embeddings changes during training and fine-tuning.
#research
🧵1/n
Check out our paper here if you haven’t already arxiv.org/pdf/2412.18452
Check out our paper here if you haven’t already arxiv.org/pdf/2412.18452
See below for my talk about diffusion geometry, including new stuff like geodesics, PDEs e.g. wave equation, and circular coordinates
See below for my talk about diffusion geometry, including new stuff like geodesics, PDEs e.g. wave equation, and circular coordinates
You can read more about it here t.co/hNC8fnU13N and introduce yourself to Liliane, another artist in residence!
You can read more about it here t.co/hNC8fnU13N and introduce yourself to Liliane, another artist in residence!
The preprint is on biorxiv now, but you can find a lot more details at www.muspan.co.uk, including documentation, worked tutorials (an ever-expanding list), install guides, and how to get the code!
The preprint is on biorxiv now, but you can find a lot more details at www.muspan.co.uk, including documentation, worked tutorials (an ever-expanding list), install guides, and how to get the code!