Andrew Ilyas
aifi.bsky.social
Andrew Ilyas
@aifi.bsky.social
Machine Learning | Stein Fellow @ Stanford Stats (current) | Assistant Prof @ CMU (incoming) | PhD @ MIT (prev)

https://andrewilyas.com
Reposted by Andrew Ilyas
"What makes a good fisherman as opposed to other professions?"
This question can be formulated as a k-linear regression problem with self-selection bias.

Alkis, @anaymehrotra.bsky.social, and I design faster local convergence algorithms for this problem:
arxiv.org/abs/2504.07133

(1/7)
Can SGD Select Good Fishermen? Local Convergence under Self-Selection Biases and Beyond
We revisit the problem of estimating $k$ linear regressors with self-selection bias in $d$ dimensions with the maximum selection criterion, as introduced by Cherapanamjeri, Daskalakis, Ilyas, and Zamp...
arxiv.org
April 19, 2025 at 5:39 PM
Had a great time @simonsinstitute.bsky.social last week talking about new & upcoming work on meta-optimization of ML training

tl;dr: we show how to compute gradients *through* the training process & use them to optimize training. Immediate big gains on data selection, poisoning, attribution & more!
April 10, 2025 at 9:34 PM
Reposted by Andrew Ilyas
We'd love to hear your feedback if you attended the ATTRIB workshop at @neuripsconf.bsky.social 2024!

Please consider taking 2-3 min to fill out this anonymous form: forms.gle/JzGebsx9haD5...

Thank you!🙏
January 20, 2025 at 11:09 PM
Our first talk of the day @ ATTRIB 2024 (Rm 205-207): @surbhigoel.bsky.social on attributing model behavior using synthetic data!
December 14, 2024 at 5:48 PM
Reposted by Andrew Ilyas
Giving a talk tomorrow at #NeurIPS2024 on the exciting topic of explainability!
At NeurIPS? Come by the 2nd workshop on Attributing Model Behavior at Scale (ATTRIB)!

Meeting Rm 205-207 @ 9am - amazing talks by @surbhigoel.bsky.social @sanmikoyejo.bsky.social Baharan Mirzasoleiman, Robert Geirhos, @coallaoh.bsky.social + exciting contributed talks!

Details: attrib-workshop.cc
ATTRIB 2024 WorkshopConference Schedule
attrib-workshop.cc
December 14, 2024 at 1:56 AM
At NeurIPS? Come by the 2nd workshop on Attributing Model Behavior at Scale (ATTRIB)!

Meeting Rm 205-207 @ 9am - amazing talks by @surbhigoel.bsky.social @sanmikoyejo.bsky.social Baharan Mirzasoleiman, Robert Geirhos, @coallaoh.bsky.social + exciting contributed talks!

Details: attrib-workshop.cc
ATTRIB 2024 WorkshopConference Schedule
attrib-workshop.cc
December 14, 2024 at 12:11 AM
Reposted by Andrew Ilyas
I am recruiting PhD students at Duke!

Please apply to Duke CS or CBB if you are interested in developing new methods and paradigms for NLP/LLMs in healthcare.
For details, see here: monicaagrawal.com/home/researc....
November 18, 2024 at 8:16 PM
Reposted by Andrew Ilyas
Primarily written for the Operations market, but folks may find this guide I wrote for the job market: gargnikhil.com/files/Nikhil...
gargnikhil.com
November 19, 2024 at 1:40 AM