C'mon. You're not even trying, now. This is mere caviling. If you believe that attaching a fallacy to an argument proves it false, that's your lone belief, not something anyone else has signed up for.
Not always, not every reference to another human speaker can be simply booted from the discussion, see Wikipedia as stated above. Or take some academic philosophy courses if you're still in doubt.