One of the advantages of GOFAI, and expert systems in particular, was that their reasoning process was a lot more transparent, and in many cases you could ask them to explain it. Much harder if all you have is dozens of arrays of connexion weights.
Perhaps this is more an exposé of human ability to generate rationalizations for chaotic biological workings of their brains, than it is a failing of neural nets to make rational decisions.
