We have enough "waste" nuclear material that could be burned again in advanced reactors that mining doesn't have to be a thing if we really got our act together.

Also, the question really is about carbon emissions vs other types of environmental impact. Batteries and solar panels require great gobs of mining infrastructure too.