> Unless physiological compatibility with a biological brain is considered an interesting endpoint?
Excellent point. I am focused entirely on synthetic simulations without biological integration (for now).
I think that could be an interesting next step - determining a way to modify a SNN that was trained in a synthetic time domain such that it can process real time signals. Training these things online is not really an option. You have to run a large # of offline simulations before you can find the right networks. Learning rules like STDP could theoretically address the online learning problem, but I couldn't find any traction down that path yet.
I had heard about spiking neural networks but I didn't really think about them until your post here. Lately I've been kind of deep diving into biological neurons (just a lay perspective) and what we know about their mechanism of action at the individual cell level. I'd also just watched the 8hr episode of Lex Fridman's podcast with the folks from Neuralink, so my brain was primed to make this connection and holy moly it's exciting to think about the possibilities.
Thanks for sharing your work, would love to see a post on here down the road when you've found some light in the dark forest.
> Lately I've been kind of deep diving into biological neurons (just a lay perspective) and what we know about their mechanism of action at the individual cell level
I've been doing the same for a long time, it's a really fun and interesting topic. I really like reading about each new discovery about something that is computationally important, people don't realize how complex a neuron is and that the scientists don't have the full picture yet.
If you haven't looked into it, check out how astrocytes are involved in computation (e.g. visual processing), their internal calcium wave signaling and their control of neurons.
Excellent point. I am focused entirely on synthetic simulations without biological integration (for now).
I think that could be an interesting next step - determining a way to modify a SNN that was trained in a synthetic time domain such that it can process real time signals. Training these things online is not really an option. You have to run a large # of offline simulations before you can find the right networks. Learning rules like STDP could theoretically address the online learning problem, but I couldn't find any traction down that path yet.