There are some 100T to 1P synapses in the 20W human brain (of which we have 8bn). Every synapse is a little molecular computer with several kinds of memory and its own inference and learning logic.

AFAIK the biggest limitation of von Neumann computers is memory bandwidth. Brain is moving 10+ PB/s between neurons. This does not count synapse-local and intra-neuron bandwidth.