NDIF Team
@ndif-team.bsky.social
The National Deep Inference Fabric, an NSF-funded computational infrastructure to enable research on large-scale Artificial Intelligence.
🔗 NDIF: https://ndif.us
🧰 NNsight API: https://nnsight.net
😸 GitHub: https://github.com/ndif-team/nnsight
🔗 NDIF: https://ndif.us
🧰 NNsight API: https://nnsight.net
😸 GitHub: https://github.com/ndif-team/nnsight
Reposted by NDIF Team
🔥I am super excited for the official release of an open-source library we've been working on for about a year!
🪄interpreto is an interpretability toolbox for HF language models🤗. In both generation and classification!
Why do you need it, and for what?
1/8 (links at the end)
🪄interpreto is an interpretability toolbox for HF language models🤗. In both generation and classification!
Why do you need it, and for what?
1/8 (links at the end)
January 20, 2026 at 4:03 PM
🔥I am super excited for the official release of an open-source library we've been working on for about a year!
🪄interpreto is an interpretability toolbox for HF language models🤗. In both generation and classification!
Why do you need it, and for what?
1/8 (links at the end)
🪄interpreto is an interpretability toolbox for HF language models🤗. In both generation and classification!
Why do you need it, and for what?
1/8 (links at the end)
New year, new YouTube videos! We are resuming our regular interpretability seminar posts, with a fantastic talk by Deepti Ghadiyaram on interpreting diffusion models.
Watch the video: youtu.be/4eqvABPX5rA
Watch the video: youtu.be/4eqvABPX5rA
Interpreting and Leveraging Diffusion Representations with Deepti Ghadiyaram
Deepti Ghadiyaram is an Assistant Professor at Boston University in the Department of Computer Science, with affiliated appointments in Electrical and Comput...
www.youtube.com
January 15, 2026 at 9:20 PM
New year, new YouTube videos! We are resuming our regular interpretability seminar posts, with a fantastic talk by Deepti Ghadiyaram on interpreting diffusion models.
Watch the video: youtu.be/4eqvABPX5rA
Watch the video: youtu.be/4eqvABPX5rA
So excited to have you on the team, @gsarti.com!
📣 I'm starting a postdoc at Northeastern University, where I will work on open-source NN interpretability with @davidbau.bsky.social and the @ndif-team.bsky.social.
In 2026, we'll grow the NDIF ecosystem and democratize access to interpretability methods for academics and domain experts! 🚀
In 2026, we'll grow the NDIF ecosystem and democratize access to interpretability methods for academics and domain experts! 🚀
January 9, 2026 at 9:39 PM
So excited to have you on the team, @gsarti.com!
nnterp by @butanium.bsky.social is now part of the NDIF ecosystem! nnterp standardizes transformer naming conventions, includes built-in best practices for common interventions, and is perfectly compatible with original HF model implementations.
Learn more: ndif-team.github.io/nnterp/
Learn more: ndif-team.github.io/nnterp/
January 9, 2026 at 9:38 PM
nnterp by @butanium.bsky.social is now part of the NDIF ecosystem! nnterp standardizes transformer naming conventions, includes built-in best practices for common interventions, and is perfectly compatible with original HF model implementations.
Learn more: ndif-team.github.io/nnterp/
Learn more: ndif-team.github.io/nnterp/
Happy Holidays from NDIF! Our new NNsight version improves performance and enhances vLLM integration, including support for tensor parallelism.
December 19, 2025 at 10:51 PM
Happy Holidays from NDIF! Our new NNsight version improves performance and enhances vLLM integration, including support for tensor parallelism.
Reposted by NDIF Team
What does an LLM do when it translates from Italian "amore" to Spanish "amor" or French "amour"?
That's easy! (you might think) Because surely it knows: amore, amor, amour are all based on the same Latin word. It can just drop the "e", or add a "u".
That's easy! (you might think) Because surely it knows: amore, amor, amour are all based on the same Latin word. It can just drop the "e", or add a "u".
October 11, 2025 at 12:02 PM
What does an LLM do when it translates from Italian "amore" to Spanish "amor" or French "amour"?
That's easy! (you might think) Because surely it knows: amore, amor, amour are all based on the same Latin word. It can just drop the "e", or add a "u".
That's easy! (you might think) Because surely it knows: amore, amor, amour are all based on the same Latin word. It can just drop the "e", or add a "u".
Reposted by NDIF Team
Making model internals accessible to domain experts in low-code interfaces will unlock the next step in making interpretability useful across a variety of domains. Very excited about the NDIF Workbench! 💡
Ever wished you could explore what's happening inside a 405B parameter model without writing any code? Workbench, our AI interpretability interface, is now live for public beta at workbench.ndif.us!
October 10, 2025 at 5:53 PM
Making model internals accessible to domain experts in low-code interfaces will unlock the next step in making interpretability useful across a variety of domains. Very excited about the NDIF Workbench! 💡
Ever wished you could explore what's happening inside a 405B parameter model without writing any code? Workbench, our AI interpretability interface, is now live for public beta at workbench.ndif.us!
October 10, 2025 at 5:35 PM
Ever wished you could explore what's happening inside a 405B parameter model without writing any code? Workbench, our AI interpretability interface, is now live for public beta at workbench.ndif.us!
New YouTube video posted! @wendlerc.bsky.social presents his work using SAEs for diffusion text-to-image models. The authors find interpretable SAE features and demonstrate how these features can alter generated images.
Watch here: youtu.be/43NnaqGjArA
Watch here: youtu.be/43NnaqGjArA
Interpreting SDXL Turbo Using Sparse Autoencoders with Chris Wendler
In this talk, Chris Wendler presents his recent work on using sparse autoencoders for diffusion models. In this work, they train SAEs on SDXL Turbo, finding ...
www.youtube.com
October 3, 2025 at 6:45 PM
New YouTube video posted! @wendlerc.bsky.social presents his work using SAEs for diffusion text-to-image models. The authors find interpretable SAE features and demonstrate how these features can alter generated images.
Watch here: youtu.be/43NnaqGjArA
Watch here: youtu.be/43NnaqGjArA
Reminder that today is the deadline to apply for our hot-swapping program! Be the first to test out many new models remotely on NDIF and submit your application today!
More details: ndif.us/hotswap.html
Application link: forms.gle/KHVkYxybmK12...
More details: ndif.us/hotswap.html
Application link: forms.gle/KHVkYxybmK12...
NSF National Deep Inference Fabric
NDIF is a research computing project that enables researchers and students to crack open the mysteries inside large-scale AI systems.
ndif.us
October 1, 2025 at 6:10 PM
Reminder that today is the deadline to apply for our hot-swapping program! Be the first to test out many new models remotely on NDIF and submit your application today!
More details: ndif.us/hotswap.html
Application link: forms.gle/KHVkYxybmK12...
More details: ndif.us/hotswap.html
Application link: forms.gle/KHVkYxybmK12...
Want increased remote model availability on NDIF? Interested in studying model checkpoints?
Sign up for the NDIF hot-swapping pilot by October 1st: forms.gle/Cf4WF3xiNzud...
Sign up for the NDIF hot-swapping pilot by October 1st: forms.gle/Cf4WF3xiNzud...
September 26, 2025 at 6:57 PM
Want increased remote model availability on NDIF? Interested in studying model checkpoints?
Sign up for the NDIF hot-swapping pilot by October 1st: forms.gle/Cf4WF3xiNzud...
Sign up for the NDIF hot-swapping pilot by October 1st: forms.gle/Cf4WF3xiNzud...
Do you wish you could run experiments on any model remotely from your laptop? In a future release, NDIF users will be able to dynamically deploy any model from HuggingFace on NDIF for remote experimentation. But before this, we need your help!
September 4, 2025 at 12:41 AM
Do you wish you could run experiments on any model remotely from your laptop? In a future release, NDIF users will be able to dynamically deploy any model from HuggingFace on NDIF for remote experimentation. But before this, we need your help!
Reposted by NDIF Team
This Friday NEMI 2025 is at Northeastern in Boston, 8 talks, 24 roundtables, 90 posters; 200+ attendees. Thanks to
goodfire.ai/ for sponsoring! nemiconf.github.io/summer25/
If you can't make it in person, the livestream will be here:
www.youtube.com/live/4BJBis...
goodfire.ai/ for sponsoring! nemiconf.github.io/summer25/
If you can't make it in person, the livestream will be here:
www.youtube.com/live/4BJBis...
New England Mechanistic Interpretability Workshop
About:The New England Mechanistic Interpretability (NEMI) workshop aims to bring together academic and industry researchers from the New England and surround...
www.youtube.com
August 18, 2025 at 6:06 PM
This Friday NEMI 2025 is at Northeastern in Boston, 8 talks, 24 roundtables, 90 posters; 200+ attendees. Thanks to
goodfire.ai/ for sponsoring! nemiconf.github.io/summer25/
If you can't make it in person, the livestream will be here:
www.youtube.com/live/4BJBis...
goodfire.ai/ for sponsoring! nemiconf.github.io/summer25/
If you can't make it in person, the livestream will be here:
www.youtube.com/live/4BJBis...
Reposted by NDIF Team
Announcing a deep net interpretability talk series!
Every week you will find new talks on recent research in the science of neural networks. The first few are posted: jackmerullo.bsky.social, Roy Rinberg, and me.
At the @ndif-team.bsky.social Youtube Channel: www.youtube.com/@NDIFTeam
Every week you will find new talks on recent research in the science of neural networks. The first few are posted: jackmerullo.bsky.social, Roy Rinberg, and me.
At the @ndif-team.bsky.social Youtube Channel: www.youtube.com/@NDIFTeam
NDIF Team
We're a research computing project cracking open the mysteries inside large-scale AI systems.
The NSF National Deep Inference Fabric consists of a unique combination of hardware and software that provides a remotely-accessible computing resource for scientists and students to perform detailed and reproducible experiments on large pretrained AI models, such as open large language models.
We aim to make AI interpretability research more accessible through this channel by publishing lectures and educational content covering real interpretability research.
www.youtube.com
August 18, 2025 at 6:02 PM
Announcing a deep net interpretability talk series!
Every week you will find new talks on recent research in the science of neural networks. The first few are posted: jackmerullo.bsky.social, Roy Rinberg, and me.
At the @ndif-team.bsky.social Youtube Channel: www.youtube.com/@NDIFTeam
Every week you will find new talks on recent research in the science of neural networks. The first few are posted: jackmerullo.bsky.social, Roy Rinberg, and me.
At the @ndif-team.bsky.social Youtube Channel: www.youtube.com/@NDIFTeam
Our YouTube channel is live! Our first video features @davidbau.bsky.social presenting the ROME project:
www.youtube.com/watch?v=eKd...
www.youtube.com/watch?v=eKd...
ROME: Locating and Editing Factual Associations in GPT with David Bau
David Bau is an Assistant Professor of Computer Science at Northeastern University's Khoury College. His lab studies the structure and interpretation of deep...
www.youtube.com
August 7, 2025 at 5:36 PM
Our YouTube channel is live! Our first video features @davidbau.bsky.social presenting the ROME project:
www.youtube.com/watch?v=eKd...
www.youtube.com/watch?v=eKd...
Induction heads are attention heads that help complete patterns by copying tokens (transformer-circuits.pub/2021/framew...), but can they also copy over concepts?
August 5, 2025 at 4:31 PM
Induction heads are attention heads that help complete patterns by copying tokens (transformer-circuits.pub/2021/framew...), but can they also copy over concepts?
Great to present what’s coming next for NDIF at the @actinterp.bsky.social workshop at #ICML2025!
If you missed us, let’s chat after the conference. Reach out here: forms.gle/LtTyYnkaxDyg...
If you missed us, let’s chat after the conference. Reach out here: forms.gle/LtTyYnkaxDyg...
July 19, 2025 at 7:54 PM
Great to present what’s coming next for NDIF at the @actinterp.bsky.social workshop at #ICML2025!
If you missed us, let’s chat after the conference. Reach out here: forms.gle/LtTyYnkaxDyg...
If you missed us, let’s chat after the conference. Reach out here: forms.gle/LtTyYnkaxDyg...
We’re excited to announce a new series of applied "mini paper" tutorials! The goal of this series is to help researchers get hands-on experience with findings, methods, and results from recent papers in interpretability using NNsight and NDIF.
July 16, 2025 at 7:41 PM
We’re excited to announce a new series of applied "mini paper" tutorials! The goal of this series is to help researchers get hands-on experience with findings, methods, and results from recent papers in interpretability using NNsight and NDIF.
Excited to share our first paper replication tutorial, walking you through the main figures from "Do Language Models Use Their Depth Efficiently?" by @robertcsordas.bsky.social
🔎 Demo on Colab: colab.research.google.com/github/ndif-...
📖 Read the full manuscript: arxiv.org/abs/2505.13898
🔎 Demo on Colab: colab.research.google.com/github/ndif-...
📖 Read the full manuscript: arxiv.org/abs/2505.13898
Google Colab
colab.research.google.com
July 4, 2025 at 12:27 AM
Excited to share our first paper replication tutorial, walking you through the main figures from "Do Language Models Use Their Depth Efficiently?" by @robertcsordas.bsky.social
🔎 Demo on Colab: colab.research.google.com/github/ndif-...
📖 Read the full manuscript: arxiv.org/abs/2505.13898
🔎 Demo on Colab: colab.research.google.com/github/ndif-...
📖 Read the full manuscript: arxiv.org/abs/2505.13898
We are prereleasing NNsight 0.5 today! We've added many highly-requested new features, including easier access to intermediate values within the forward pass, ability to run any code within NNsight’s tracing context (no more proxies!), and easier debugging.
June 20, 2025 at 9:09 PM
We are prereleasing NNsight 0.5 today! We've added many highly-requested new features, including easier access to intermediate values within the forward pass, ability to run any code within NNsight’s tracing context (no more proxies!), and easier debugging.
Are you interested in researching diffusion models in NNsight? We've released our first non-LLM tutorial, which covers the Diffusion Lens technique!
May 22, 2025 at 6:22 PM
Are you interested in researching diffusion models in NNsight? We've released our first non-LLM tutorial, which covers the Diffusion Lens technique!
At #ICLR2025 in Singapore? Come visit our poster tomorrow (Saturday, April 26th)! This work addresses a critical gap in ML research: the ability to study the internals of very large neural networks.
April 25, 2025 at 6:03 PM
At #ICLR2025 in Singapore? Come visit our poster tomorrow (Saturday, April 26th)! This work addresses a critical gap in ML research: the ability to study the internals of very large neural networks.
Reposted by NDIF Team
What will be the linchpin for AI dominance?
Read our NSF/OSTP recommendations written with Goodfire's Tom McGrath tommcgrath.github.io, Transluce's Sarah Schwettmann cogconfluence.com, MIT's Dylan Hadfield-Menell @dhadfieldmenell.bsky.social
TLDR; Dominance comes from **interpretability** 🧵 ↘️
Read our NSF/OSTP recommendations written with Goodfire's Tom McGrath tommcgrath.github.io, Transluce's Sarah Schwettmann cogconfluence.com, MIT's Dylan Hadfield-Menell @dhadfieldmenell.bsky.social
TLDR; Dominance comes from **interpretability** 🧵 ↘️
March 16, 2025 at 1:57 PM
What will be the linchpin for AI dominance?
Read our NSF/OSTP recommendations written with Goodfire's Tom McGrath tommcgrath.github.io, Transluce's Sarah Schwettmann cogconfluence.com, MIT's Dylan Hadfield-Menell @dhadfieldmenell.bsky.social
TLDR; Dominance comes from **interpretability** 🧵 ↘️
Read our NSF/OSTP recommendations written with Goodfire's Tom McGrath tommcgrath.github.io, Transluce's Sarah Schwettmann cogconfluence.com, MIT's Dylan Hadfield-Menell @dhadfieldmenell.bsky.social
TLDR; Dominance comes from **interpretability** 🧵 ↘️