RAG is a powerful way to improve LLMs' answering abilities across many languages. But how do LLMs deal with multilingual contexts? Do they answer consistently when the retrieved info is provided to them in different languages?

Joint work w/ @jiruiqi.bsky.social & Raquel_Fernández
See thread! ⤵️

🗞️ A simple trick improves embedding retrieval performance even without further training.

ZCA whitening increases isotropy of the embedding space and thereby helps retrieval

Paper by Andor Diera and with @lukasgalke.bsky.social at ESANN 2025.

Preprint: arxiv.org/abs/2411.17538

Thrilled to share our #ICLR2025 work on Meta-Causal States! 🌟 Causal graphs evolve with dynamic systems & agent actions. We show how to cluster causal models by qualitative behavior, revealing hidden dynamics & emergent relationships 🚀 #Causality #ML

https://arxiv.org/abs/2410.13054

Deep neural networks and humans both benefit from compositional language structure. New paper by @lukasgalke.bsky.social, Yoav Ram, and @limorraviv.bsky.social. doi.org/10.1038/s414....

🔥 Now finally out in Nature Communications:

Deep neural networks and humans both benefit from compositional structure

with Yoav Ram and @limorraviv.bsky.social

Paper link right away: rdcu.be/d5f2e

🧵⬇️

Two more days left to apply for PhD positions on training multilingual language models at the Centre for Machine Learning in the Department of Mathematics and Computer Science (IMADA), University of Southern Denmark (SDU).

tinyurl.com/dfm2025phd

Application deadline: Dec 19, 2024

tell me about LLMs tool use best practices. I know the high level, and want to learn about implementation/prompting details, e.g.:
- how do you best feed in the tool specs or DSL to the LLM?
- how do you ask it to indicate a tool use (which wrapper / indicator)
- how do you ask for nested calls
etc

We have some openings for PhD/Postdoc positions on multilingual language modeling at SDU's Centre for Machine Learning, Denmark. Topics go down to the core of pre-training and instruction tuning and adjacent topics such as efficient language modeling. Please consider to apply :)

Research positions on LLMs and available at the SDU Centre for ML:

tinyurl.com/dfm2025phd
tinyurl.com/dfm2025postdoc

I'm Lukas, working on machine learning and natural language processing. I'm particularly interested in interpretability of language models, efficient language models, continual learning, ood generalization, and machine communication.

I hope to find a community like the ex-twitter ML community here.