Spanish girls are reporting AI-generated nudes being circulated at school

https://english.elpais.com/international/2023-09-18/in-spain-dozens-of-girls-are-reporting-ai-generated-nude-photos-of-them-being-circulated-at-school-my-heart-skipped-a-beat.html

by fooker • 3 years ago

43 50 3 years ago

english.elpais.com

xchip3• 3 years ago

How come this is only happening in Spain?

pvaldes2• 3 years ago

Is a test?. The app was offered only targeting Spanish children and riding the current wave of moral panic. The more transgressive it seems, the more attractive will be seen by children craving to be targeted as "malote" by their peers. So yep.

Hey boy, try this "free" app and create fake nudes of your friendenemies with the chain of selfies that they drop all the time. Lots of lols guaranteed.

Soon in your own children's room with a 150% probability. This is just a preheating (IMAO).

tasubotadas• 3 years ago

Some teenager with right skills and intention just happened to be living in Spain.

Not all of the tech world lives in the SV.

Am4TIfIsER0ppos2• 3 years ago

Spain has probably the most progressive government in Europe so they'll use specter of harming women to pass more laws outlawing more software. It'll then go up to the EU so they can control us a little more.

I must say the story sounds like an older scam in which you "romance" someone to get them to send you naked pictures of themselves then extort them. The AI just skips the time cost to get the material.

dangus3• 3 years ago

Spain has probably the most progressive government in Europe

Uh, citation needed on that one.

https://www.reuters.com/world/europe/spains-far-right-vox-op...

https://sensationalspain.com/is-spain-liberal/

rgmerk• 3 years ago

I’ll bet a substantial amount of money it’s happening elsewhere.

And sooner or later I’d expect the developers of at least one of these apps to end up in serious legal trouble.

viraptor• 3 years ago

It's been found, talked about, and got enough notice to make news which made it to HN... from Spain. Other places are either not aware yet, or not making enough noise. The models are available everywhere - I'm sure it's happening all over the place.

pvaldes2• 3 years ago

I'm sure it's happening all over the place.

Meanwhile last week in Sweden

https://www.theguardian.com/world/2023/sep/11/sweden-says-ba...

Probably related.

ethanbond7• 3 years ago

This has been discussed on HN before and the overwhelming HN response was “why would you care, it’s not an actual nude?”

Lots of tasteless people doubled down that they wouldn’t even care if it were their own children or wives (let’s be real, it’ll be 99% women and children) being portrayed like this against their consent (“consent” doesn’t exist in such a context, the argument goes).

The only defense against this, which is already too late for most extant children to employ, is to never post photos of your children online. But hey whatever it takes to avoid scrutiny and regulation eh?

TBC, I’m not saying it’s obvious how to regulate/control/mitigate it, but that’s a totally different argument from the one I encountered which was “there’s no relevant concept of consent.”

prepend4• 3 years ago

For me, it’s not that Im tasteless, it’s that I don’t think consent is needed to make an image with my face put into a naked body. At least if it’s for personal use.

In the US at least, there are laws that prevent commercialization of my likeness, or harassment, or defamation. And those can be applied if someone sells images of me on a nude bode.

But for personal use, it seems as pointless to outlaw as someone imagining me naked. Is that “tasteless?” Perhaps. Of my child, that’s gross.

Im not sure how to stop this though as I think any control to try to outlaw perverts from staring at people, or drawing images of people, or using these apps without consent would cause more harm than the harm they seek to prevent.

corethree4• 3 years ago

This is a fine line. There are people who care. But at the same time this crosses boundaries of freedom of speech.

The content is completely generated and and there is effort to censor this content.

Think about it. Censoring generated content is equivalent to censoring art. It's morally equivalent to censoring art because you don't like the art.

There's a problem from many perspectives and no one perspective is completely right. There's the female perspective where their beauty, rank and character is judged on their perceived promiscuity levels. Pictures obviously effect the womens ranking and the spouses care too so this is a factor. But it does not negate the existence of the freedom of speech perspective too.

The problem here is that it's too fuzzy you can't strictly define what is creative art and what is a reputation bashing porno. What if the art was generated but just happens to look like the daughter off of pure coincidence? Similar to how a real person can look like another person randomly.

What if someone that looks extremely similar to you starts modelling for porn. Do you ban and censor that person? Do you ban art that coincidentally looks like you? What if there's nude art where half the population finds it offensive and the other half does not?

Once you cross this line because the boundaries are so fuzzy it's easy to overstep.

China a very hated country by the US doesn't consider freedom of speech. They jump right in with what they believe to be the most reasonable decision. They would of course severely punish anyone who makes AI generated porn of real people. But we all know the consequence of this is china crosses too many fuzzy lines.

If you have a wife and daughter do you prefer the china way or the more "freedom of speech" way?

xchip3• 3 years ago

You are changing the question to a different one and then answering it. There should be a fallacy name for this.

CatWChainsaw2• 3 years ago

I would be interested to hear how they would view the situation if someone was creating deepfakes of their mutilated corpses. Or their family's mutilated corpses. You know, because since it's all synthetic no harm could have possibly been done.

dangus3• 3 years ago

You wouldn’t say that about a news story in the New York Times would you?

This is a Spanish newspaper covering news in Spain.

entwife• 3 years ago

It is news in Spain because, in Spain, there is a 1000+ euro fine for transmitting intimate photos of a person (of any age) without their consent. This applies to anyone who transmits the photo, including third parties. The controversy and legal question is whether or not these photos constitute intimate photos.

This probably happens elsewhere, but there is no legal mechanism to prevent it.

Eumenes• 3 years ago

Where's Franco when you need him

julienreszka• 3 years ago

in some AI nudes, probably

pewpew2020• 3 years ago

Even if your real nudes leak, now you can always say they are ai-generated :)

corethree4• 3 years ago

Maybe this is what's actually occuring.

tamimio2• 3 years ago

I think that’s exactly what’s happening.

xchip3• 3 years ago

If this is true, how comes we are not seeing nudes of every famous person?

erellsworth• 3 years ago

Probably because you're not looking for them?

CatWChainsaw2• 3 years ago

Well when you have a lot of money you can afford a legal team that can preemptively terrorize people for publishing anything that has even a whiff of bad press. Why do you think the offshore financial world can maintain the level of secrecy it has.

tamimio2• 3 years ago

I think it’s the other way around, I think AI is being the scapegoat in this scenario, notice this is coming from different cultures that might be extremely taboo to have such thing around, so what’s a better way to refute the whole leak? Say it’s fake, remember, before AI, the scapegoat was photoshop, “that’s not me that’s photoshop” it goes, however, it was relatively easy to find if it really was or not, AI on the other hand, requires some more investigation, and that might be for public figures or politicians, it won’t for a bunch of school students.