Research Fellow @imperialcollegeldn.bsky.social and @imperial-ix.bsky.social
Funded by @schmidtsciences.bsky.social
So the ones which do get reviewed tend to be high-quality!
Even if, like the paper @neural-reckoning.org is referring to, the reviewers don't agree with everything.
So the ones which do get reviewed tend to be high-quality!
Even if, like the paper @neural-reckoning.org is referring to, the reviewers don't agree with everything.
You may be interested in our recent work too!
We define 128 RNN architectures then compare their behaviour and dynamics (using gradient-based metrics).
bsky.app/profile/marc...
@neuralreckoning.bsky.social & I explore this in our new preprint:
doi.org/10.1101/2025...
🤖🧠🧪
🧵1/9
You may be interested in our recent work too!
We define 128 RNN architectures then compare their behaviour and dynamics (using gradient-based metrics).
bsky.app/profile/marc...
* AI in Science (2 years) - www.imperial.ac.uk/ix-ai-in-sci...
* ICRF (4 years) - www.imperial.ac.uk/research-and...
* AI in Science (2 years) - www.imperial.ac.uk/ix-ai-in-sci...
* ICRF (4 years) - www.imperial.ac.uk/research-and...
I'm not quite ready to post my applications online, but am happy to share them privately.
Just DM or email me 🙂
I'm not quite ready to post my applications online, but am happy to share them privately.
Just DM or email me 🙂
We think these models (pRNNs) are exciting for thinking about structure-function relations in artificial and biological neural networks.
bsky.app/profile/marc...
@neuralreckoning.bsky.social & I explore this in our new preprint:
doi.org/10.1101/2025...
🤖🧠🧪
🧵1/9
We think these models (pRNNs) are exciting for thinking about structure-function relations in artificial and biological neural networks.
bsky.app/profile/marc...
Hopefully see you somewhere in Europe soon!
Hopefully see you somewhere in Europe soon!
But, I don't remember seeing an algorithm-centric version?
But, I don't remember seeing an algorithm-centric version?
Exciting to see an inversion of NeuroAI too
Exciting to see an inversion of NeuroAI too
It could be interesting to explore heterogenous neuromodulation?
In this case, having multiple modulator networks which act at different timescales and exert different effects on the downstream SNN?
This would be a bit closer to neuromodulators in vivo.
It could be interesting to explore heterogenous neuromodulation?
In this case, having multiple modulator networks which act at different timescales and exert different effects on the downstream SNN?
This would be a bit closer to neuromodulators in vivo.
And it's not obvious that this problem vanishes in more complex circuits?
And it's not obvious that this problem vanishes in more complex circuits?
But even if we did, many studies would describe these "population dynamics" as a line attractor.
Rather than just a single neuron acting on it's own?
But even if we did, many studies would describe these "population dynamics" as a line attractor.
Rather than just a single neuron acting on it's own?
But, these seem to be the exception?
And perhaps the language used in the non-causal studies can be a bit misleading?
For instance, the post that launched this thread claimed that "the brain uses distributed coding" (based on solely on recordings).
But, these seem to be the exception?
And perhaps the language used in the non-causal studies can be a bit misleading?
For instance, the post that launched this thread claimed that "the brain uses distributed coding" (based on solely on recordings).
And it's not obvious that this problem vanishes in more complex circuits?
And it's not obvious that this problem vanishes in more complex circuits?
For example, given LIF dynamics it could perform temporal coincidence detection (only outputting spikes in response to inputs close together in time).
For example, given LIF dynamics it could perform temporal coincidence detection (only outputting spikes in response to inputs close together in time).
But even if we did, many studies would describe these "population dynamics" as a line attractor.
Rather than just a single neuron acting on it's own.
But even if we did, many studies would describe these "population dynamics" as a line attractor.
Rather than just a single neuron acting on it's own.
But, it seems like this remains underexplored?
Keen to hear your thoughts @mattperich.bsky.social, @juangallego.bsky.social and others!
www.nature.com/articles/s41...
🧵5/5
But, it seems like this remains underexplored?
Keen to hear your thoughts @mattperich.bsky.social, @juangallego.bsky.social and others!
www.nature.com/articles/s41...
🧵5/5