While I suspect you're right, anecdotal evidence must be fairly weak here. Not many people would admit to themselves that they weren't up to the intellectual challenge -- let alone admit it to other people.
My own experience was that part of the problem was that there was no intellectual challenge. I actually suspect that if PhD programs were a little more intellectually challenging drop-out rates would go down.