The club I curl at is strictly dedicated curling ice and most curlers there take care and pride in the ice and work to keep it clean and in to condition. But we are also open to introducing people and bringing new curlers in. Sometimes people don't wear ideal clothing. They will wear clothes that is linty/fuzzy. Some lint or fuzz gets in the ice and a slow curled stone goes over a piece in the ice which causes a lot of friction b pulling the stone and causing it to start curling the opposite way. That's what I often see. Another thing that sometimes messed with the ice and can cause negative curl is outside conditions. The building isn't perfectly sealed and there are doors to the exterior 3 feet from the outer sheets. If it's above freezing the warm air seeping in can cause the ice near the doors to be frosty or wet (or even colder than normal and harder to melt from some friction if it's extremely cold outside). Depending on conditions. This can mess with the friction between the ice and stone regardless of spin direction.
Probably gravity. Shaving the ice in the same pattern every time, or excessive traffic on the edges of the sheet probably cause uneven surfaces over time.
To your edit:
> Curling on ice used for other purposes too leads to shitty ice
Certainly skating ice is a whole other beast to curl on, but I'm talking about club ice: Ice that is only used for curling.