sexual_tomato@lemmy.dbzer0.comtoTechnology@lemmy.world•Child safety org launches AI model trained on real child sex abuse imagesEnglish
194·
3 days agoJesus Christ. If someone ever got their hands on this model they could use it to generate new material. The grossest possible AI model to date
A generative model uses the classifier as part of its training. If you generate a picture of pure random noise, then iteratively pick random noise that the classifier says “looks” more like csam, then you can effectively generate images that the classifier says it’s 100% certain is csam. Whether or not that looks anything like what a human would consider to be csam depends on other factors but it remains a possibility.