Perhaps data is only correct if it was acquired ethically? :/ Maybe the unethical collection of data introduces large margins of error from the ethic-goblins.

You're missing the point. It has nothing to do with the correctness of the data, and everything to do with the means used to collect it. See also: torture & search warrants.

Torture introduces possible error into data. So it's an extremely bad analogy.

Picking up a sheet of paper doesn't call the validity of the data into question. It's still the same data.