When I have internal conversation with myself, there is no difference between lose and loose. Probably because in my native language both pronunciations are indistinguishable.

And also at least partly because I mostly work with polite people who will not point out my language mistakes. And I never attended any classes to have a chance for a teacher to weed it out.

As to your comment about sloppiness/ignorance, you might be ignorant thinking that because you care it means everybody else also has to.