@lucasmgomez.bsky.social
I couldn't find anything online showing how to use the new FlexAttention methods from torch>=2.5 to handle causal attention masking of padded inputs.
So I made a tutorial...
github.com/lucasmgomez/...
medium.com/@lucasmgomez...
So I made a tutorial...
github.com/lucasmgomez/...
medium.com/@lucasmgomez...
Casual Attention with Padded Inputs via PyTorch FlexAttention
Casual Attention with Padded Inputs via PyTorch FlexAttention
medium.com
December 29, 2024 at 9:04 PM
I couldn't find anything online showing how to use the new FlexAttention methods from torch>=2.5 to handle causal attention masking of padded inputs.
So I made a tutorial...
github.com/lucasmgomez/...
medium.com/@lucasmgomez...
So I made a tutorial...
github.com/lucasmgomez/...
medium.com/@lucasmgomez...
Reposted
🌟 New Research Alert! 🌟
Excited to share our latest work (accepted to NeurIPS2024) on understanding working memory in multi-task RNN models using naturalistic stimuli!: with @takuito.bsky.social and @bashivan.bsky.social
#tweeprint below:
Excited to share our latest work (accepted to NeurIPS2024) on understanding working memory in multi-task RNN models using naturalistic stimuli!: with @takuito.bsky.social and @bashivan.bsky.social
#tweeprint below:
November 28, 2024 at 4:41 PM
🌟 New Research Alert! 🌟
Excited to share our latest work (accepted to NeurIPS2024) on understanding working memory in multi-task RNN models using naturalistic stimuli!: with @takuito.bsky.social and @bashivan.bsky.social
#tweeprint below:
Excited to share our latest work (accepted to NeurIPS2024) on understanding working memory in multi-task RNN models using naturalistic stimuli!: with @takuito.bsky.social and @bashivan.bsky.social
#tweeprint below:
Reposted
1/ I work in #NeuroAI, a growing field of research, which many people have only the haziest conception of...
As way of introduction to this research approach, I'll provide here a very short thread outlining the definition of the field I gave recently at our BRAIN NeuroAI workshop at the NIH.
🧠📈
As way of introduction to this research approach, I'll provide here a very short thread outlining the definition of the field I gave recently at our BRAIN NeuroAI workshop at the NIH.
🧠📈
November 21, 2024 at 4:20 PM
1/ I work in #NeuroAI, a growing field of research, which many people have only the haziest conception of...
As way of introduction to this research approach, I'll provide here a very short thread outlining the definition of the field I gave recently at our BRAIN NeuroAI workshop at the NIH.
🧠📈
As way of introduction to this research approach, I'll provide here a very short thread outlining the definition of the field I gave recently at our BRAIN NeuroAI workshop at the NIH.
🧠📈