I think most opponents of stop and frisk disagree with you: it's both. Police routinely "predict" that black and brown people are criminals, and stop and frisk allows them to act on these predictions without evidence. I think the argument here is that systems like Palantir quickly and easily become a technological proxy for these "predictions" and makes permanent the biases and racism used to create the data sets that drive them.
If NYPD set up patrols on wall street to stop and frisk bankers on their way home from work searching for cocaine or evidence of fraud it would be a very different issue.
I'm not sure if I have parsed this correctly. My understanding of stop and frisk is that there is a significant racial bias involved. To me this seems like part of the prediction. In my mind both aspects of stop and frisk are problematic.