[YokoSix]

It's the same as with parents photographing their naked babies in the bathtub. Those images won't be flagged because they aren't in the database provided to Apple. Only verified illegal photos should be in the database. So you and your girlfriend will be fine.

[echohack5]

> Only verified illegal photos should be in the database.

Considering PhotoDNA, the source code of Apple's implementation, a 30-year Ph.D. level in cryptographic knowledge, and the processes by which neuralMatch actually run are unavailable to the OP, I think OP is justified in the minor paranoia of not wanting to be falsely accused of owning CSAM.

That's precisely the problem with Apple's announcement here. You can't apply common sense to an algorithm and dragnet-style surveillance.

I doubt even Apple specifically knows precisely how things will turn out with this system.

[tiagod]

These are perceptual hashes though.

What if you take a picture of your naked baby in the bathtub or your child on the beach, and the picture is very similar to a known CSAM picture with a hash in the database, enough to pass the distance threshold they're using?

The picture would be sent for screening, the Apple screener would indeed say that's a naked baby/child, and soon enough you've got the FBI (or whatever is the equivalent in your country) knocking on your door and arresting you for pedophilia.

[kickopotomus]

> Those images won't be flagged because they aren't in the database provided to Apple

This is not accurate. Apple is using perceptual hashes. If the features of an image are close enough to an image in the NCMEC database it may generate a matching hash.

[yakkityyak]

Not defending the new tech by any means, but you'd have to have enough matches to exceed some hidden threshold, which would first trigger a manual review by Apple. It seems very unlikely to have your own family photo result trigger anything.

[ByteWelder]

The problem with that is that the threshold is unknown, so it could be 2 or 3.

[Hackbraten]

Until one of the OF patrons mistakes her for a minor, reports the images, and their hashes somehow end up in NCMEC’s database.