Oliver Lemon
@oliverlemon.bsky.social
880 followers 730 following 32 posts
Prof in CS; Academic Lead of National Robotarium; ELLIS Fellow; Edinburgh Centre for Robotics; Heriot-Watt, Edinburgh. Postdocs at Stanford and Edinburgh. Research in NLP, dialogue, conversational AI, multimodality, robots, embodied AI, collaborative AI
Posts Media Videos Starter Packs
Reposted by Oliver Lemon
Think your LLMs “understand” words like although/but/therefore? Think again!

They perform at chance for making inferences from certain discourse connectives expressing concession
"Although I hate leafy vegetables, I prefer daxes to blickets." Can you tell if daxes are leafy vegetables? LM's can't seem to! 📷

We investigate if LMs capture these inferences from connectives when they cannot rely on world knowledge.

New paper w/ Daniel, Will, @jessyjli.bsky.social
Title page of the paper: WUGNECTIVES: Novel Entity Inferences of Language Models from Discourse Connectives, with two figures at the bottom

Left: Our figure 1 -- comparing previous work, which usually predicted the connective given the arguments (grounded in the world); our work flips this premise by getting models to use their knowledge of connectives to predict something about the world.

Right: Our main results across 7 types of connective senses. Models are especially bad at Concession connectives.
Open PhD position in embodied AI, Edinburgh - applications closing soon!
PhD position available ! - Generative AI for Embodied Collaborative Agents (eg. robots :) - Please distribute
PhD position in Generative AI for Embodied Collaborative Agents: #GenAI #NLProc #HRI #ELLISforEurope #AI #ML #PhD @heriotwattuni.bsky.social - please contact me ASAP if you are interested !
sites.google.com/site/hwinter...
PhD positions in AI/Robotics/NLP -- deadline Friday, 14 November 2025 ! Edinburgh, Scotland 🤖🗣️ -- please share!
www.cdt-d2air.uk
Reposted by Oliver Lemon
Reposted by Oliver Lemon
🚀 Shape the future of European AI! The @ellis.eu PhD Programme is opening for applications.

🧠 Work with top researchers, join joint supervision 🤝 and benefit from networking 🌐 & training 🎓

Info session: Oct 1, 16:00 CET.

Everything you need to know is one click away 👉 ellis.eu/news/ellis-p...
Reposted by Oliver Lemon
This week's #PaperILike is "Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Models" (Shi et al., ICML 2025).

I'm often asked: how might we combine ideas from hierarchical planning and VLAs? This is a good start!

PDF: arxiv.org/abs/2502.19417
Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Models
Generalist robots that can perform a range of different tasks in open-world settings must be able to not only reason about the steps needed to accomplish their goals, but also process complex instruct...
arxiv.org
PhD position available ! - Generative AI for Embodied Collaborative Agents (eg. robots :) - Please distribute
"Learnings" and "advancements", both common in AI papers
Full Professor position in AI/CS -- Deadline for applications 23rd June!
Reposted by Oliver Lemon
Reposted by Oliver Lemon
The regular submission deadline for SIGdial 2025 has now passed...

But we are still welcoming submissions through ACL Rolling Review 🎉

ARR Commitment Deadline: June 6th

Acceptance notifications will be on June 20th, and then SIGdial will be held in Avignon, France: August 25th - 27th
Reposted by Oliver Lemon
🚨 New pre-print! (Well, new & much improved version in any case.) 🚨
If you're interested in LLM post-training techniques and in how to make LLMs better "language users", read this thread, introducing the "LM Playpen".
Title of the paper, with a colourful "playpen" logo
Please can you post the arxiv link? Thanks!