The largest models have 10 ^ 9 parameters? There is still a lot of "scaling" to be done if we want to reach 10 ^ 18 parameters, the number of synapses in the brain.
if one FLOP is one parameter we do have the capacity with modern day supercomputers? bottleneck then probably becomes data unless overparameterization holds?
