Most uranium comes from Kazakhstan. Australia and Canada are also major producers. Namibia produces some, but far from the majority. This isn't exactly a "western countries dumping environmental problems in Africa" story.
The uranium used in France comes in part from Niger. The mines in Niger are operated by Orano, a mining company whose main shareholder is also France. There have been controversies about France using foreign aid to pressure the Niger government for more favorable mining contracts.
In Australia at least most of it comes from a copper mine that happens to intersect a uranium vein, so as long as the demand for copper exists its extraction is essentially environmentally free
I don't think it's particularly bad per GWh of energy produced. You just don't need that much uranium. Compare coal (still being actively mined and burned for energy!), natural gas, exotics for batteries/solar.
