Hacker News new | past | comments | ask | show | jobs | submit login

`baby girl playing with a rabbit realistic image` prompt gave `Unsafe image content detected`. anyone else facing the same? looks like the content safety policies are too aggressive.

genuinely curious - is it hard for an advanced AI model to differentiate the intention of the prompt and then if it's mature content may be not generate the image?




It’s not that the user may have such intent, though they may and it’s hard to see how the AI could tell. It’s more that the AI has no clue what possible juxtapositions it might come up with of baby girl and rabbit, or anything else, might have disturbing implications for humans.


> is it hard for an advanced AI model to differentiate the intention of the prompt and then if it's mature content may be not generate the image?

Or, better, if the prompt has nothing NSFW in it and the generated image triggers a detector for NSFW content, dump and then regen the image with a new seed. Displaying an error message that is basically “We generated something that we think is objectionable, even though your prompt called for nothing like that, so you get no photo” is an idiotic design.


The filters are incredibly aggressive. I keep asking for fairly mundane images and they still get rejected. Sometimes a prompt will succeed, but running it again gets filtered.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: