BlackboxNLP
@blackboxnlp.bsky.social
The largest workshop on analysing and interpreting neural networks for NLP.
BlackboxNLP will be held at EMNLP 2025 in Suzhou, China
blackboxnlp.github.io
BlackboxNLP will be held at EMNLP 2025 in Suzhou, China
blackboxnlp.github.io
Our panel moderated by @danaarad.bsky.social
"Evaluating Interpretability Methods: Challenges and Future Directions" just started! 🎉 Come to learn more about the MIB benchmark and hear the takes of @michaelwhanna.bsky.social, Michal Golovanevsky, Nicolò Brunello and Mingyang Wang!
"Evaluating Interpretability Methods: Challenges and Future Directions" just started! 🎉 Come to learn more about the MIB benchmark and hear the takes of @michaelwhanna.bsky.social, Michal Golovanevsky, Nicolò Brunello and Mingyang Wang!
November 9, 2025 at 6:55 AM
Our panel moderated by @danaarad.bsky.social
"Evaluating Interpretability Methods: Challenges and Future Directions" just started! 🎉 Come to learn more about the MIB benchmark and hear the takes of @michaelwhanna.bsky.social, Michal Golovanevsky, Nicolò Brunello and Mingyang Wang!
"Evaluating Interpretability Methods: Challenges and Future Directions" just started! 🎉 Come to learn more about the MIB benchmark and hear the takes of @michaelwhanna.bsky.social, Michal Golovanevsky, Nicolò Brunello and Mingyang Wang!
Next up: Kentaro Ozeki presenting "Normative Reasoning in Large Language Models: A Comparative Benchmark from Logical and Modal Perspectives" aclanthology.org/2025.blackbo...
November 9, 2025 at 6:32 AM
Next up: Kentaro Ozeki presenting "Normative Reasoning in Large Language Models: A Comparative Benchmark from Logical and Modal Perspectives" aclanthology.org/2025.blackbo...
After a productive poster session, BlackboxNLP returns with the second keynote "Memorization: Myth or Mystery?" by @vernadankers.bsky.social!
November 9, 2025 at 5:48 AM
After a productive poster session, BlackboxNLP returns with the second keynote "Memorization: Myth or Mystery?" by @vernadankers.bsky.social!
Nadav Shani is giving the first oral presentation of the day: Language Dominance in Multilingual Large Language Models. Find the paper here: aclanthology.org/2025.blackbo...
November 9, 2025 at 2:19 AM
Nadav Shani is giving the first oral presentation of the day: Language Dominance in Multilingual Large Language Models. Find the paper here: aclanthology.org/2025.blackbo...
Next up: Circuit-Tracer: A New Library for Finding Feature Circuits presented by @michaelwhanna.bsky.social! Paper: aclanthology.org/2025.blackbo...
November 9, 2025 at 2:18 AM
Next up: Circuit-Tracer: A New Library for Finding Feature Circuits presented by @michaelwhanna.bsky.social! Paper: aclanthology.org/2025.blackbo...
Reposted by BlackboxNLP
I'll be presenting this work at @blackboxnlp.bsky.social in Suzhou, happy to chat there or here if you are interested !
October 22, 2025 at 8:16 AM
I'll be presenting this work at @blackboxnlp.bsky.social in Suzhou, happy to chat there or here if you are interested !
Reposted by BlackboxNLP
Nov 9, @blackboxnlp.bsky.social , 11:00-12:00 @ Hall C – Interpreting Language Models Through Concept Descriptions: A Survey (Feldhus & Kopf) @lkopf.bsky.social
🗞️ aclanthology.org/2025.blackbo...
bsky.app/profile/nfel...
🗞️ aclanthology.org/2025.blackbo...
bsky.app/profile/nfel...
November 6, 2025 at 7:00 AM
Nov 9, @blackboxnlp.bsky.social , 11:00-12:00 @ Hall C – Interpreting Language Models Through Concept Descriptions: A Survey (Feldhus & Kopf) @lkopf.bsky.social
🗞️ aclanthology.org/2025.blackbo...
bsky.app/profile/nfel...
🗞️ aclanthology.org/2025.blackbo...
bsky.app/profile/nfel...
Quanshi Zhang is giving the first keynote of the day: Can Neural Network Interpretability Be the Key to Breaking Through Scaling Law Limitations in Deep Learning?
November 9, 2025 at 1:38 AM
Quanshi Zhang is giving the first keynote of the day: Can Neural Network Interpretability Be the Key to Breaking Through Scaling Law Limitations in Deep Learning?
BlackboxNLP is up and running! Here's the topics covered by this year's edition at a glance. Excited to see so many interesting topics, and the growing interest in reasoning!
November 9, 2025 at 1:38 AM
BlackboxNLP is up and running! Here's the topics covered by this year's edition at a glance. Excited to see so many interesting topics, and the growing interest in reasoning!
📢 Call for Papers! 📢
#BlackboxNLP 2025 invites the submission of archival and non-archival papers on interpreting and explaining NLP models.
📅 Deadlines: Aug 15 (direct submissions), Sept 5 (ARR commitment)
🔗 More details: blackboxnlp.github.io/2025/call/
#BlackboxNLP 2025 invites the submission of archival and non-archival papers on interpreting and explaining NLP models.
📅 Deadlines: Aug 15 (direct submissions), Sept 5 (ARR commitment)
🔗 More details: blackboxnlp.github.io/2025/call/
August 12, 2025 at 7:10 PM
📢 Call for Papers! 📢
#BlackboxNLP 2025 invites the submission of archival and non-archival papers on interpreting and explaining NLP models.
📅 Deadlines: Aug 15 (direct submissions), Sept 5 (ARR commitment)
🔗 More details: blackboxnlp.github.io/2025/call/
#BlackboxNLP 2025 invites the submission of archival and non-archival papers on interpreting and explaining NLP models.
📅 Deadlines: Aug 15 (direct submissions), Sept 5 (ARR commitment)
🔗 More details: blackboxnlp.github.io/2025/call/
Writing your technical report for the MIB shared task?
Take a look at the task page for guidelines and tips!
Take a look at the task page for guidelines and tips!
📝 Technical report guidelines are out!
If you're submitting to the MIB Shared Task at #BlackboxNLP, feel free to take a look to help you prepare your report: blackboxnlp.github.io/2025/task/
If you're submitting to the MIB Shared Task at #BlackboxNLP, feel free to take a look to help you prepare your report: blackboxnlp.github.io/2025/task/
August 6, 2025 at 9:51 AM
Writing your technical report for the MIB shared task?
Take a look at the task page for guidelines and tips!
Take a look at the task page for guidelines and tips!
The report deadline was also extended to August 10th!
Note that this is a final extension. We look forward to reading your reports! ✍️
Note that this is a final extension. We look forward to reading your reports! ✍️
Results deadline extended by one week!
Following requests from participants, we’re extending the MIB Shared Task submission deadline by one week.
🗓️ New deadline: August 8, 2025
Submit your method via the MIB leaderboard!
Following requests from participants, we’re extending the MIB Shared Task submission deadline by one week.
🗓️ New deadline: August 8, 2025
Submit your method via the MIB leaderboard!
August 6, 2025 at 9:49 AM
The report deadline was also extended to August 10th!
Note that this is a final extension. We look forward to reading your reports! ✍️
Note that this is a final extension. We look forward to reading your reports! ✍️
Just 5 days left to submit your method to the MIB Shared Task at #BlackboxNLP!
Have last-minute questions or need help finalizing your submission?
Join the Discord server: discord.gg/n5uwjQcxPR
Have last-minute questions or need help finalizing your submission?
Join the Discord server: discord.gg/n5uwjQcxPR
August 3, 2025 at 6:40 AM
Just 5 days left to submit your method to the MIB Shared Task at #BlackboxNLP!
Have last-minute questions or need help finalizing your submission?
Join the Discord server: discord.gg/n5uwjQcxPR
Have last-minute questions or need help finalizing your submission?
Join the Discord server: discord.gg/n5uwjQcxPR
With the new extended deadline, there's still plenty of time to submit your method to the MIB Shared Task!
We welcome submissions of existing methods, experimental POCs, or any approach addressing circuit discovery or causal variable localization 💡
We welcome submissions of existing methods, experimental POCs, or any approach addressing circuit discovery or causal variable localization 💡
July 30, 2025 at 5:57 AM
With the new extended deadline, there's still plenty of time to submit your method to the MIB Shared Task!
We welcome submissions of existing methods, experimental POCs, or any approach addressing circuit discovery or causal variable localization 💡
We welcome submissions of existing methods, experimental POCs, or any approach addressing circuit discovery or causal variable localization 💡
Results deadline extended by one week!
Following requests from participants, we’re extending the MIB Shared Task submission deadline by one week.
🗓️ New deadline: August 8, 2025
Submit your method via the MIB leaderboard!
Following requests from participants, we’re extending the MIB Shared Task submission deadline by one week.
🗓️ New deadline: August 8, 2025
Submit your method via the MIB leaderboard!
July 29, 2025 at 9:35 AM
Results deadline extended by one week!
Following requests from participants, we’re extending the MIB Shared Task submission deadline by one week.
🗓️ New deadline: August 8, 2025
Submit your method via the MIB leaderboard!
Following requests from participants, we’re extending the MIB Shared Task submission deadline by one week.
🗓️ New deadline: August 8, 2025
Submit your method via the MIB leaderboard!
📝 Technical report guidelines are out!
If you're submitting to the MIB Shared Task at #BlackboxNLP, feel free to take a look to help you prepare your report: blackboxnlp.github.io/2025/task/
If you're submitting to the MIB Shared Task at #BlackboxNLP, feel free to take a look to help you prepare your report: blackboxnlp.github.io/2025/task/
July 28, 2025 at 12:34 PM
📝 Technical report guidelines are out!
If you're submitting to the MIB Shared Task at #BlackboxNLP, feel free to take a look to help you prepare your report: blackboxnlp.github.io/2025/task/
If you're submitting to the MIB Shared Task at #BlackboxNLP, feel free to take a look to help you prepare your report: blackboxnlp.github.io/2025/task/
Just 10 days to go until the results submission deadline for the MIB Shared Task at #BlackboxNLP!
If you're working on:
🧠 Circuit discovery
🔍 Feature attribution
🧪 Causal variable localization
now’s the time to polish and submit!
Join us on Discord: discord.gg/n5uwjQcxPR
If you're working on:
🧠 Circuit discovery
🔍 Feature attribution
🧪 Causal variable localization
now’s the time to polish and submit!
Join us on Discord: discord.gg/n5uwjQcxPR
July 23, 2025 at 7:42 AM
Just 10 days to go until the results submission deadline for the MIB Shared Task at #BlackboxNLP!
If you're working on:
🧠 Circuit discovery
🔍 Feature attribution
🧪 Causal variable localization
now’s the time to polish and submit!
Join us on Discord: discord.gg/n5uwjQcxPR
If you're working on:
🧠 Circuit discovery
🔍 Feature attribution
🧪 Causal variable localization
now’s the time to polish and submit!
Join us on Discord: discord.gg/n5uwjQcxPR
Reposted by BlackboxNLP
Are you attending ICML? 👀
I'm sadly not, but if you are, you should check out the MIB 🕶️poster at 11AM: icml.cc/virtual/2025...
The benchmark is used as the shared task at this year's
@blackboxnlp.bsky.social (blackboxnlp.github.io/2025/task/) - there's still time to participate 🏆
I'm sadly not, but if you are, you should check out the MIB 🕶️poster at 11AM: icml.cc/virtual/2025...
The benchmark is used as the shared task at this year's
@blackboxnlp.bsky.social (blackboxnlp.github.io/2025/task/) - there's still time to participate 🏆
July 17, 2025 at 3:56 PM
Are you attending ICML? 👀
I'm sadly not, but if you are, you should check out the MIB 🕶️poster at 11AM: icml.cc/virtual/2025...
The benchmark is used as the shared task at this year's
@blackboxnlp.bsky.social (blackboxnlp.github.io/2025/task/) - there's still time to participate 🏆
I'm sadly not, but if you are, you should check out the MIB 🕶️poster at 11AM: icml.cc/virtual/2025...
The benchmark is used as the shared task at this year's
@blackboxnlp.bsky.social (blackboxnlp.github.io/2025/task/) - there's still time to participate 🏆
⏳ Three weeks left! Submit your work to the MIB Shared Task at #BlackboxNLP, co-located with @emnlpmeeting.bsky.social
Whether you're working on circuit discovery or causal variable localization, this is your chance to benchmark your method in a rigorous setup!
Whether you're working on circuit discovery or causal variable localization, this is your chance to benchmark your method in a rigorous setup!
July 13, 2025 at 5:56 AM
⏳ Three weeks left! Submit your work to the MIB Shared Task at #BlackboxNLP, co-located with @emnlpmeeting.bsky.social
Whether you're working on circuit discovery or causal variable localization, this is your chance to benchmark your method in a rigorous setup!
Whether you're working on circuit discovery or causal variable localization, this is your chance to benchmark your method in a rigorous setup!
Have you started working on your submission for the MIB shared task yet? Tell us what you’re exploring!
New featurization methods?
Circuit pruning?
Better feature attribution?
We'd love to hear about it 👇
New featurization methods?
Circuit pruning?
Better feature attribution?
We'd love to hear about it 👇
July 9, 2025 at 7:15 AM
Have you started working on your submission for the MIB shared task yet? Tell us what you’re exploring!
New featurization methods?
Circuit pruning?
Better feature attribution?
We'd love to hear about it 👇
New featurization methods?
Circuit pruning?
Better feature attribution?
We'd love to hear about it 👇
Working on feature attribution, circuit discovery, feature alignment, or sparse coding?
Consider submitting your work to the MIB Shared Task, part of this year’s #BlackboxNLP
We welcome submissions of both existing methods and new or experimental POCs!
Consider submitting your work to the MIB Shared Task, part of this year’s #BlackboxNLP
We welcome submissions of both existing methods and new or experimental POCs!
July 8, 2025 at 9:35 AM
Working on feature attribution, circuit discovery, feature alignment, or sparse coding?
Consider submitting your work to the MIB Shared Task, part of this year’s #BlackboxNLP
We welcome submissions of both existing methods and new or experimental POCs!
Consider submitting your work to the MIB Shared Task, part of this year’s #BlackboxNLP
We welcome submissions of both existing methods and new or experimental POCs!
New to mechanistic interpretability?
The MIB shared task is a great opportunity to experiment:
✅ Clean setup
✅ Open baseline code
✅ Standard evaluation
Join the discord server for ideas and discussions: discord.gg/n5uwjQcxPR
The MIB shared task is a great opportunity to experiment:
✅ Clean setup
✅ Open baseline code
✅ Standard evaluation
Join the discord server for ideas and discussions: discord.gg/n5uwjQcxPR
July 7, 2025 at 8:42 AM
New to mechanistic interpretability?
The MIB shared task is a great opportunity to experiment:
✅ Clean setup
✅ Open baseline code
✅ Standard evaluation
Join the discord server for ideas and discussions: discord.gg/n5uwjQcxPR
The MIB shared task is a great opportunity to experiment:
✅ Clean setup
✅ Open baseline code
✅ Standard evaluation
Join the discord server for ideas and discussions: discord.gg/n5uwjQcxPR
Reposted by BlackboxNLP
The wait is over! 🎉 Our speakers for #BlackboxNLP 2025 are finally out!
🚨 Excited to announce two invited speakers at #BlackboxNLP 2025!
Join us to hear from two leading voices in interpretability:
🎙️ Quanshi Zhang (Shanghai Jiao Tong University)
🎙️ Verna Dankers (McGill University)
@vernadankers.bsky.social
Join us to hear from two leading voices in interpretability:
🎙️ Quanshi Zhang (Shanghai Jiao Tong University)
🎙️ Verna Dankers (McGill University)
@vernadankers.bsky.social
July 4, 2025 at 9:37 AM
The wait is over! 🎉 Our speakers for #BlackboxNLP 2025 are finally out!
🚨 Excited to announce two invited speakers at #BlackboxNLP 2025!
Join us to hear from two leading voices in interpretability:
🎙️ Quanshi Zhang (Shanghai Jiao Tong University)
🎙️ Verna Dankers (McGill University)
@vernadankers.bsky.social
Join us to hear from two leading voices in interpretability:
🎙️ Quanshi Zhang (Shanghai Jiao Tong University)
🎙️ Verna Dankers (McGill University)
@vernadankers.bsky.social
July 4, 2025 at 8:14 AM
🚨 Excited to announce two invited speakers at #BlackboxNLP 2025!
Join us to hear from two leading voices in interpretability:
🎙️ Quanshi Zhang (Shanghai Jiao Tong University)
🎙️ Verna Dankers (McGill University)
@vernadankers.bsky.social
Join us to hear from two leading voices in interpretability:
🎙️ Quanshi Zhang (Shanghai Jiao Tong University)
🎙️ Verna Dankers (McGill University)
@vernadankers.bsky.social
One month to go! ⏰
Working on featurization methods - ways to transform LM activations to better isolate causal variables?
Submit your work to the Causal Variable Localization Track of the MIB Shared Task!
Working on featurization methods - ways to transform LM activations to better isolate causal variables?
Submit your work to the Causal Variable Localization Track of the MIB Shared Task!
July 1, 2025 at 4:49 PM
One month to go! ⏰
Working on featurization methods - ways to transform LM activations to better isolate causal variables?
Submit your work to the Causal Variable Localization Track of the MIB Shared Task!
Working on featurization methods - ways to transform LM activations to better isolate causal variables?
Submit your work to the Causal Variable Localization Track of the MIB Shared Task!