Dominik Dold
banner
dodo47.bsky.social
Dominik Dold
@dodo47.bsky.social
Physics Dr. 🧙‍♂️ interested in intelligence, both artificial 🤖 and biological 🧠 Marie Curie Fellow at Uni Vienna 🥐☕️ Prev. ESA ACT & Siemens. He/him.
This work has been funded by @ec.europa.eu and was performed at @univie.ac.at 🤗
May 2, 2025 at 8:09 AM
You can find the preprint on arXiv: arxiv.org/abs/2504.14015

We believe that this measure can be used to study and improve various aspects of spiking neural networks, from neuron models to initialisation schemes and training methods! 😊
Causal pieces: analysing and improving spiking neural networks piece by piece
We introduce a novel concept for spiking neural networks (SNNs) derived from the idea of "linear pieces" used to analyse the expressiveness and trainability of artificial neural networks (ANNs). We pr...
arxiv.org
May 2, 2025 at 8:07 AM
2. The more causal pieces the training data falls into before training, the higher the chances that the network trains successfully and reaches a high performance 📈 Hence, this measure can be used to guide initialisation of spiking neural networks.
May 2, 2025 at 8:07 AM
We found that the number of such causal pieces has some cool properties:

1. The approximation error is lower bounded by an expression depending on the inverse squared of the number of causal pieces. More pieces, less error (which does not mean better generalization though)!
May 2, 2025 at 8:07 AM
A causal piece is, quite literally, a piece of the input (and parameter) space where the network output is always caused by the same network components. Or simply put: the path through the network stays the same.

That's all the differently coloured regions shown above - one colour 🟩 = 🧩 one piece!
May 2, 2025 at 8:07 AM
I'd say that's pretty good loot ;)
March 1, 2025 at 9:36 PM
So I guess you didn't find two huge guys with pumpkins on their head down there? :D
March 1, 2025 at 6:35 PM
I (unfortunately) have no book recommendations, but when there: definitely check out the Herculaneum archaeological site, absolutely mind-blowing! :)
November 29, 2024 at 10:40 PM
🙋🏼
November 20, 2024 at 7:37 PM