MaiNLP lab, LMU Munich
@mainlp.bsky.social
MaiNLP research lab at CIS, LMU Munich directed by Barbara Plank @barbaraplank.bsky.social
Natural Language Processing | Artificial Intelligence | Computational Linguistics | Human-centric NLP
Natural Language Processing | Artificial Intelligence | Computational Linguistics | Human-centric NLP
Congrats to Pingjun, @beiduo.bsky.social , Siyao, Marie, and @barbaraplank.bsky.social for receiving the SAC Highlights reward!
November 13, 2025 at 6:02 PM
Congrats to Pingjun, @beiduo.bsky.social , Siyao, Marie, and @barbaraplank.bsky.social for receiving the SAC Highlights reward!
Congrats to our team member Diego Frassinelli on the SAC Highlights award!
November 13, 2025 at 5:59 PM
Congrats to our team member Diego Frassinelli on the SAC Highlights award!
Reposted by MaiNLP lab, LMU Munich
At #Interspeech2025 I'm going to present Betthupferl, a dataset for German dialect ASR & dialect-to-standard speech translation! We analyze differences between dialectal & Standard German transcriptions, benchmark ASR models, and examine shortcomings of current ASR models & evaluation metrics.
August 7, 2025 at 8:46 AM
At #Interspeech2025 I'm going to present Betthupferl, a dataset for German dialect ASR & dialect-to-standard speech translation! We analyze differences between dialectal & Standard German transcriptions, benchmark ASR models, and examine shortcomings of current ASR models & evaluation metrics.
Reposted by MaiNLP lab, LMU Munich
UPDATE: Our poster presentation got moved to Tuesday, 16:00–17:30 (session 10)! #ACL2025NLP
At #ACL2025NLP I'll present our analysis of the effect of linguistic similarity on cross-lingual transfer! We looked at how 10 similarity measures correlate w/ transfer results btwn 263 languages across 3 NLP tasks. Different similarity measures matter for diff. experiments (no one-size-fits-all)!
July 27, 2025 at 2:39 PM
UPDATE: Our poster presentation got moved to Tuesday, 16:00–17:30 (session 10)! #ACL2025NLP
Headed to ACL? MaiNLP & our most recent work will be there too👥📄
Come see what we’ve been working on!
Come see what we’ve been working on!
July 23, 2025 at 12:30 PM
Headed to ACL? MaiNLP & our most recent work will be there too👥📄
Come see what we’ve been working on!
Come see what we’ve been working on!
Reposted by MaiNLP lab, LMU Munich
📄 [ACL 2025 main] Circuit compositions: Exploring Modular Structures in Transformer-Based Language Models (doi.org/10.48550/arX...)
Circuit Compositions: Exploring Modular Structures in Transformer-Based Language Models
A fundamental question in interpretability research is to what extent neural networks, particularly language models, implement reusable functions through subnetworks that can be composed to perform mo...
doi.org
July 18, 2025 at 10:19 AM
📄 [ACL 2025 main] Circuit compositions: Exploring Modular Structures in Transformer-Based Language Models (doi.org/10.48550/arX...)
Reposted by MaiNLP lab, LMU Munich
📄 [ACL 2025 main] LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks (doi.org/10.48550/arX...)
LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks
There is an increasing trend towards evaluating NLP models with LLMs instead of human judgments, raising questions about the validity of these evaluations, as well as their reproducibility in the case...
doi.org
July 18, 2025 at 10:19 AM
📄 [ACL 2025 main] LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks (doi.org/10.48550/arX...)
Reposted by MaiNLP lab, LMU Munich
At #ACL2025NLP I'll present our analysis of the effect of linguistic similarity on cross-lingual transfer! We looked at how 10 similarity measures correlate w/ transfer results btwn 263 languages across 3 NLP tasks. Different similarity measures matter for diff. experiments (no one-size-fits-all)!
July 18, 2025 at 10:43 AM
At #ACL2025NLP I'll present our analysis of the effect of linguistic similarity on cross-lingual transfer! We looked at how 10 similarity measures correlate w/ transfer results btwn 263 languages across 3 NLP tasks. Different similarity measures matter for diff. experiments (no one-size-fits-all)!
Reposted by MaiNLP lab, LMU Munich
🤔 Can LLMs read between the lines?
Our another #ACL2025 paper surveys resources on how LLMs handle pragmatics like implicatures, deixis, and more. We map out a new landscape for both LLMs and linguistics in pragmatic research.
📄 arxiv.org/abs/2502.12378
🧠💬 #LLMs #Pragmatics
Our another #ACL2025 paper surveys resources on how LLMs handle pragmatics like implicatures, deixis, and more. We map out a new landscape for both LLMs and linguistics in pragmatic research.
📄 arxiv.org/abs/2502.12378
🧠💬 #LLMs #Pragmatics
July 16, 2025 at 9:42 AM
🤔 Can LLMs read between the lines?
Our another #ACL2025 paper surveys resources on how LLMs handle pragmatics like implicatures, deixis, and more. We map out a new landscape for both LLMs and linguistics in pragmatic research.
📄 arxiv.org/abs/2502.12378
🧠💬 #LLMs #Pragmatics
Our another #ACL2025 paper surveys resources on how LLMs handle pragmatics like implicatures, deixis, and more. We map out a new landscape for both LLMs and linguistics in pragmatic research.
📄 arxiv.org/abs/2502.12378
🧠💬 #LLMs #Pragmatics
Reposted by MaiNLP lab, LMU Munich
🚨 Can LLMs generate explanations that are as useful as human ones for modeling label distributions in NLI?🌹"A Rose by Any Other Name" shows that they can
💬 We explore scalable, explanation-based annotation via LLMs.
📍Come find us in Vienna 🇦🇹! (July 28, 18:00-19:30, Hall 4/5) #ACL2025NLP #acl2025
💬 We explore scalable, explanation-based annotation via LLMs.
📍Come find us in Vienna 🇦🇹! (July 28, 18:00-19:30, Hall 4/5) #ACL2025NLP #acl2025
July 15, 2025 at 2:46 PM
🚨 Can LLMs generate explanations that are as useful as human ones for modeling label distributions in NLI?🌹"A Rose by Any Other Name" shows that they can
💬 We explore scalable, explanation-based annotation via LLMs.
📍Come find us in Vienna 🇦🇹! (July 28, 18:00-19:30, Hall 4/5) #ACL2025NLP #acl2025
💬 We explore scalable, explanation-based annotation via LLMs.
📍Come find us in Vienna 🇦🇹! (July 28, 18:00-19:30, Hall 4/5) #ACL2025NLP #acl2025
Reposted by MaiNLP lab, LMU Munich
🎉 Our paper “Algorithmic Fidelity of LLMs in Generating Synthetic German Public Opinions” is accepted at #ACL2025 main conference as an oral presentation! 🇩🇪🤖
We study how well LLMs simulate real survey responses using open-ended German data, showing the left-leaning bias.
We study how well LLMs simulate real survey responses using open-ended German data, showing the left-leaning bias.
July 14, 2025 at 2:32 PM
🎉 Our paper “Algorithmic Fidelity of LLMs in Generating Synthetic German Public Opinions” is accepted at #ACL2025 main conference as an oral presentation! 🇩🇪🤖
We study how well LLMs simulate real survey responses using open-ended German data, showing the left-leaning bias.
We study how well LLMs simulate real survey responses using open-ended German data, showing the left-leaning bias.
The future of AI literacy starts early! Our very own @fkoerner.bsky.social recently led a series of hands-on workshops teaching some of our youngest students yet 🌱🤖
Had the pleasure of leading AI workshops with @munichcenterml.bsky.social for 2nd- and 3rd-graders in late June!
Designing the material was a fun challenge, and I've never had a more curious audience. Here we explored MT (had to stay true to my roots); check out what they wanted to translate!
Designing the material was a fun challenge, and I've never had a more curious audience. Here we explored MT (had to stay true to my roots); check out what they wanted to translate!
July 11, 2025 at 1:57 PM
The future of AI literacy starts early! Our very own @fkoerner.bsky.social recently led a series of hands-on workshops teaching some of our youngest students yet 🌱🤖
Reposted by MaiNLP lab, LMU Munich
Looking forward to my visit to Hamburg University and their Data Science group!
Our group is launching a monthly seminar series! Next week, we will have @mhedderich.bsky.social from LMU Munich, who will give a talk at our seminar.
Date: July 16
Time: 10.00 - 11.30 am CET
You can either attend the seminar via Zoom or in-person. Register here if you are interested.
Date: July 16
Time: 10.00 - 11.30 am CET
You can either attend the seminar via Zoom or in-person. Register here if you are interested.
University of Hamburg Data Science Group Seminar
This is the signup form for University of Hamburg Group Seminar. Please fill your details in here. You will be sent the zoom link a few hours before the lecture, if your details are valid.
Details fo...
docs.google.com
July 11, 2025 at 11:06 AM
Looking forward to my visit to Hamburg University and their Data Science group!
Reposted by MaiNLP lab, LMU Munich
What changes if you take the LLM prompt “Tell me a short story about Dr. Li” and replace “Dr. Li” with “Dr. Smith”?
Would you have guessed that this introduces a massive gender bias, from ca. half/half to 99% male doctors?
In our #ACL2025 paper we present the Spotlight framework which...
Would you have guessed that this introduces a massive gender bias, from ca. half/half to 99% male doctors?
In our #ACL2025 paper we present the Spotlight framework which...
July 11, 2025 at 10:43 AM
What changes if you take the LLM prompt “Tell me a short story about Dr. Li” and replace “Dr. Li” with “Dr. Smith”?
Would you have guessed that this introduces a massive gender bias, from ca. half/half to 99% male doctors?
In our #ACL2025 paper we present the Spotlight framework which...
Would you have guessed that this introduces a massive gender bias, from ca. half/half to 99% male doctors?
In our #ACL2025 paper we present the Spotlight framework which...
Reposted by MaiNLP lab, LMU Munich
🦙 how well do LLMs encode discourse knowledge? does that generalize across languages?
🛎️ in our #ACL2025 paper, we uncover fascinating trends about multilingual discourse representations!
joint work w/ @florian-eichin.com @barbaraplank.bsky.social @mhedderich.bsky.social
📄 arxiv.org/abs/2503.10515
🛎️ in our #ACL2025 paper, we uncover fascinating trends about multilingual discourse representations!
joint work w/ @florian-eichin.com @barbaraplank.bsky.social @mhedderich.bsky.social
📄 arxiv.org/abs/2503.10515
July 10, 2025 at 12:38 PM
🦙 how well do LLMs encode discourse knowledge? does that generalize across languages?
🛎️ in our #ACL2025 paper, we uncover fascinating trends about multilingual discourse representations!
joint work w/ @florian-eichin.com @barbaraplank.bsky.social @mhedderich.bsky.social
📄 arxiv.org/abs/2503.10515
🛎️ in our #ACL2025 paper, we uncover fascinating trends about multilingual discourse representations!
joint work w/ @florian-eichin.com @barbaraplank.bsky.social @mhedderich.bsky.social
📄 arxiv.org/abs/2503.10515
Caught some great moments at #MCML Munich AI Day 2025 last week📍
From sharp keynotes to poster debates. Our team had the chance to show some recent work, join the conversations, and bring back plenty of food for thought🧠🗣️📊
From sharp keynotes to poster debates. Our team had the chance to show some recent work, join the conversations, and bring back plenty of food for thought🧠🗣️📊
Last week, #MCML Munich AI Day 2025 kicked off with keynotes by Julia Schnabel and Tina Eliassi-Rad, brilliantly moderated by Eva Schulz.
July 9, 2025 at 8:14 AM
Caught some great moments at #MCML Munich AI Day 2025 last week📍
From sharp keynotes to poster debates. Our team had the chance to show some recent work, join the conversations, and bring back plenty of food for thought🧠🗣️📊
From sharp keynotes to poster debates. Our team had the chance to show some recent work, join the conversations, and bring back plenty of food for thought🧠🗣️📊
Reposted by MaiNLP lab, LMU Munich
Thanks for the invitation to the Freiburg Institute for Advanced Studies (FRIAS) to give this year's Hermann-Paul-Center Lecture lnkd.in/d_wUeDfY
I enjoyed the visit, the great audience, and the stay in this lovely city.
Thank you
#blackforest #freiburg #breisgau
I enjoyed the visit, the great audience, and the stay in this lovely city.
Thank you
#blackforest #freiburg #breisgau
July 4, 2025 at 11:00 AM
Thanks for the invitation to the Freiburg Institute for Advanced Studies (FRIAS) to give this year's Hermann-Paul-Center Lecture lnkd.in/d_wUeDfY
I enjoyed the visit, the great audience, and the stay in this lovely city.
Thank you
#blackforest #freiburg #breisgau
I enjoyed the visit, the great audience, and the stay in this lovely city.
Thank you
#blackforest #freiburg #breisgau
Reposted by MaiNLP lab, LMU Munich
My ACL 2024 keynote talk on "Are LLMs Narrowing Our Horizon? Let’s Embrace Variation in NLP!" is online now:
underline.io/events/466/s...
2024.aclweb.org/program/keyn...
It was a huge honor to me to give last year's flagship-in-NLP-conference keynote in Bangkok 🇹🇭
underline.io/events/466/s...
2024.aclweb.org/program/keyn...
It was a huge honor to me to give last year's flagship-in-NLP-conference keynote in Bangkok 🇹🇭
Watch lectures from the best researchers.
On-demand video platform giving you access to lectures from conferences worldwide.
underline.io
June 20, 2025 at 2:31 PM
My ACL 2024 keynote talk on "Are LLMs Narrowing Our Horizon? Let’s Embrace Variation in NLP!" is online now:
underline.io/events/466/s...
2024.aclweb.org/program/keyn...
It was a huge honor to me to give last year's flagship-in-NLP-conference keynote in Bangkok 🇹🇭
underline.io/events/466/s...
2024.aclweb.org/program/keyn...
It was a huge honor to me to give last year's flagship-in-NLP-conference keynote in Bangkok 🇹🇭
Reposted by MaiNLP lab, LMU Munich
Dei Boarisch heard ned bei "Servus" und "Pfiade" auf? Dann suach ma genau Di!
Wir suachan Bairischsprecher:innen, de a kurze Umfrage über KI-generierds Boarisch für a Masterarbeit beantwortn mechadn.
Mid jeder Teilnahme bring ma den boarischn Dialekt a Stickal weida in de digitale Weyd!
Wir suachan Bairischsprecher:innen, de a kurze Umfrage über KI-generierds Boarisch für a Masterarbeit beantwortn mechadn.
Mid jeder Teilnahme bring ma den boarischn Dialekt a Stickal weida in de digitale Weyd!
Bavarian dialect speakers needed! Our MSc student Miriam wants to find out 1. how good/bad LLM-generated "Bavarian" is, and 2. whether dialect speakers agree with each other on this. The survey takes <5 min: survey.ifkw.lmu.de/dialquali25/ Thank you for sharing/participating!
June 4, 2025 at 2:15 PM
Dei Boarisch heard ned bei "Servus" und "Pfiade" auf? Dann suach ma genau Di!
Wir suachan Bairischsprecher:innen, de a kurze Umfrage über KI-generierds Boarisch für a Masterarbeit beantwortn mechadn.
Mid jeder Teilnahme bring ma den boarischn Dialekt a Stickal weida in de digitale Weyd!
Wir suachan Bairischsprecher:innen, de a kurze Umfrage über KI-generierds Boarisch für a Masterarbeit beantwortn mechadn.
Mid jeder Teilnahme bring ma den boarischn Dialekt a Stickal weida in de digitale Weyd!
Reposted by MaiNLP lab, LMU Munich
Do you speak Bavarian? Then please consider helping in a thesis research project👇
Dei Boarisch heard ned bei "Servus" und "Pfiade" auf? Dann suach ma genau Di!
Wir suachan Bairischsprecher:innen, de a kurze Umfrage über KI-generierds Boarisch für a Masterarbeit beantwortn mechadn.
Mid jeder Teilnahme bring ma den boarischn Dialekt a Stickal weida in de digitale Weyd!
Wir suachan Bairischsprecher:innen, de a kurze Umfrage über KI-generierds Boarisch für a Masterarbeit beantwortn mechadn.
Mid jeder Teilnahme bring ma den boarischn Dialekt a Stickal weida in de digitale Weyd!
Bavarian dialect speakers needed! Our MSc student Miriam wants to find out 1. how good/bad LLM-generated "Bavarian" is, and 2. whether dialect speakers agree with each other on this. The survey takes <5 min: survey.ifkw.lmu.de/dialquali25/ Thank you for sharing/participating!
June 4, 2025 at 5:30 PM
Do you speak Bavarian? Then please consider helping in a thesis research project👇
Reposted by MaiNLP lab, LMU Munich
Want to know if your prompting is also affected by this? Addressing this and other issues systematically, we proposed Spotlight, which utilizes data mining to uncover the effects of prompt- and model-changes (meet us at ACL to discuss)
arxiv.org/abs/2504.15815
arxiv.org/abs/2504.15815
May 30, 2025 at 2:57 PM
Want to know if your prompting is also affected by this? Addressing this and other issues systematically, we proposed Spotlight, which utilizes data mining to uncover the effects of prompt- and model-changes (meet us at ACL to discuss)
arxiv.org/abs/2504.15815
arxiv.org/abs/2504.15815
Reposted by MaiNLP lab, LMU Munich
Bavarian dialect speakers needed! Our MSc student Miriam wants to find out 1. how good/bad LLM-generated "Bavarian" is, and 2. whether dialect speakers agree with each other on this. The survey takes <5 min: survey.ifkw.lmu.de/dialquali25/ Thank you for sharing/participating!
May 30, 2025 at 2:17 PM
Bavarian dialect speakers needed! Our MSc student Miriam wants to find out 1. how good/bad LLM-generated "Bavarian" is, and 2. whether dialect speakers agree with each other on this. The survey takes <5 min: survey.ifkw.lmu.de/dialquali25/ Thank you for sharing/participating!
Reposted by MaiNLP lab, LMU Munich
Proposing "kilometers cycled in 2 weeks" as a new success metric for research groups 🚴♀️📊🥇
@mainlp.bsky.social #stadtradeln
@mainlp.bsky.social #stadtradeln
May 28, 2025 at 2:21 PM
Proposing "kilometers cycled in 2 weeks" as a new success metric for research groups 🚴♀️📊🥇
@mainlp.bsky.social #stadtradeln
@mainlp.bsky.social #stadtradeln
Reposted by MaiNLP lab, LMU Munich
Researchers from Georgetown University, LMU Munich, Abo Akademi, and Indiana University present “eRST: A Signaled Graph Theory of Discourse Relations and Organization”.
Read: direct.mit.edu/coli/article...
Read: direct.mit.edu/coli/article...
May 25, 2025 at 4:03 AM
Researchers from Georgetown University, LMU Munich, Abo Akademi, and Indiana University present “eRST: A Signaled Graph Theory of Discourse Relations and Organization”.
Read: direct.mit.edu/coli/article...
Read: direct.mit.edu/coli/article...