Sameer Singh
@sameer-singh.bsky.social
CS Prof at UC Irvine, CTO/Cofounder at Envive AI
Work on evaluation and robustness of LLMs
Work on evaluation and robustness of LLMs
Pinned
Sameer Singh
@sameer-singh.bsky.social
· Nov 19
Started a SoCal AI/ML/NLP researchers starter pack! It's a bit sparse right now, and perhaps more NLP heavy, but hey, nominate yourself and others! go.bsky.app/6QckPj9
LLMs giveth and LLM taketh away
September 2, 2025 at 3:56 PM
LLMs giveth and LLM taketh away
Reposted by Sameer Singh
Reposted by Sameer Singh
Published some notes on Microsoft's phi4-reasoning model, an 11GB download (via Ollama) which may well overthink things... it produced 56 sentences of reasoning output in response to my prompt of "hi" simonwillison.net/2025/May/6/p...
May 6, 2025 at 6:47 PM
Published some notes on Microsoft's phi4-reasoning model, an 11GB download (via Ollama) which may well overthink things... it produced 56 sentences of reasoning output in response to my prompt of "hi" simonwillison.net/2025/May/6/p...
Reposted by Sameer Singh
meet Chris J Li - this titan of thought has single-handedly conquered the fields of machine learning, optimization, statistics, reinforcement learning, and federated learning.
he's not the visionary we want, but judging by the current state of affairs, he may be the one we deserve
he's not the visionary we want, but judging by the current state of affairs, he may be the one we deserve
February 23, 2025 at 7:19 AM
meet Chris J Li - this titan of thought has single-handedly conquered the fields of machine learning, optimization, statistics, reinforcement learning, and federated learning.
he's not the visionary we want, but judging by the current state of affairs, he may be the one we deserve
he's not the visionary we want, but judging by the current state of affairs, he may be the one we deserve
Reposted by Sameer Singh
Defended 🎉🎓
Big thanks to @royf.org, @sameer-singh.bsky.social, and labmates for their mentorship and support over the past 5 years!
Big thanks to @royf.org, @sameer-singh.bsky.social, and labmates for their mentorship and support over the past 5 years!
February 7, 2025 at 6:17 PM
Defended 🎉🎓
Big thanks to @royf.org, @sameer-singh.bsky.social, and labmates for their mentorship and support over the past 5 years!
Big thanks to @royf.org, @sameer-singh.bsky.social, and labmates for their mentorship and support over the past 5 years!
Reposted by Sameer Singh
How do LLMs interpret expressions of linguistic uncertainty such as "highly unlikely"? Short answer: pretty well .... unless they have relevant prior knowledge. Details in our EMNLP paper aclanthology.org/2024.emnlp-m... (with Kat Belem, Markelle Kelly, Mark Steyvers, @sameer-singh.bsky.social).
aclanthology.org
January 22, 2025 at 12:03 AM
How do LLMs interpret expressions of linguistic uncertainty such as "highly unlikely"? Short answer: pretty well .... unless they have relevant prior knowledge. Details in our EMNLP paper aclanthology.org/2024.emnlp-m... (with Kat Belem, Markelle Kelly, Mark Steyvers, @sameer-singh.bsky.social).
Reposted by Sameer Singh
Turned @dippedrusk.bsky.social 's amazing Vancouver list dippedrusk.com/posts/2024-0... into Google Maps pins: maps.app.goo.gl/nGBbcUAMMixC...
Vagrant's Vancouver | Vagrant Gautam
A non-comprehensive list of places to go and things to do in the Greater Vancouver Area as curated by yours truly over 6 years. Might be outdated so please double-check!
dippedrusk.com
December 10, 2024 at 7:52 PM
Turned @dippedrusk.bsky.social 's amazing Vancouver list dippedrusk.com/posts/2024-0... into Google Maps pins: maps.app.goo.gl/nGBbcUAMMixC...
Excited about #NeurIPS2024, my 15th one I think! Eager to meet everyone & hear abt your work! But if you want to hear me, there's an exciting panel tonight lu.ma/v7oohp0u
Also SpiffyAI is hiring ML engineers & UCI CS is hiring AI faculty, pls reach out to chat! 🧵
Also SpiffyAI is hiring ML engineers & UCI CS is hiring AI faculty, pls reach out to chat! 🧵
From Research to Commercialization: A Fireside Chat with Senior AI Leaders · Luma
From Research to Commercialization
Join us for a conversation with speakers who made the leap from top research institutions to industry and are shaping how…
lu.ma
December 10, 2024 at 9:59 PM
Excited about #NeurIPS2024, my 15th one I think! Eager to meet everyone & hear abt your work! But if you want to hear me, there's an exciting panel tonight lu.ma/v7oohp0u
Also SpiffyAI is hiring ML engineers & UCI CS is hiring AI faculty, pls reach out to chat! 🧵
Also SpiffyAI is hiring ML engineers & UCI CS is hiring AI faculty, pls reach out to chat! 🧵
Reposted by Sameer Singh
If you use SHAP, LIME or Data Shapley, you might be interested in our new #neurips2024 paper. We introduce stochastic amortization to speed up feature + data attribution by 10x-100x 🚀 #XML
Surprisingly we can "learn to attribute" cheaply from noisy explanations! arxiv.org/abs/2401.15866
Surprisingly we can "learn to attribute" cheaply from noisy explanations! arxiv.org/abs/2401.15866
December 2, 2024 at 5:35 PM
If you use SHAP, LIME or Data Shapley, you might be interested in our new #neurips2024 paper. We introduce stochastic amortization to speed up feature + data attribution by 10x-100x 🚀 #XML
Surprisingly we can "learn to attribute" cheaply from noisy explanations! arxiv.org/abs/2401.15866
Surprisingly we can "learn to attribute" cheaply from noisy explanations! arxiv.org/abs/2401.15866
Read only the first 1-2 sentences of each and go with your gut. You'll likely get the perfect score!
Kind of thing where I probably prefer an unaligned model output to an aligned one..
Kind of thing where I probably prefer an unaligned model output to an aligned one..
November 21, 2024 at 2:19 AM
Read only the first 1-2 sentences of each and go with your gut. You'll likely get the perfect score!
Kind of thing where I probably prefer an unaligned model output to an aligned one..
Kind of thing where I probably prefer an unaligned model output to an aligned one..
Reposted by Sameer Singh
Yeah I just said "I love you" to Claude, enough work for today
November 20, 2024 at 12:44 AM
Yeah I just said "I love you" to Claude, enough work for today
Started a SoCal AI/ML/NLP researchers starter pack! It's a bit sparse right now, and perhaps more NLP heavy, but hey, nominate yourself and others! go.bsky.app/6QckPj9
November 19, 2024 at 3:28 PM
Started a SoCal AI/ML/NLP researchers starter pack! It's a bit sparse right now, and perhaps more NLP heavy, but hey, nominate yourself and others! go.bsky.app/6QckPj9
Had a fun week at #EMNLP2024 in Miami, meeting folks old and new, along with the #UCINLP lab retreat! See everyone at the next one!
November 17, 2024 at 12:17 PM
Had a fun week at #EMNLP2024 in Miami, meeting folks old and new, along with the #UCINLP lab retreat! See everyone at the next one!