From what I remember from development 101, there are also more possible synaptic connections in early childhood, and these get pruned down over time. This would also reduce the amount signals travel.