Hacker News new | ask | show | jobs
by dylan604 1715 days ago
But that's how physics work. If iPhone Macro doesn't suffer the same issues, then it's a software trick
3 comments

Depth of field is a direct function of real-world focal length. An iPhone has camera systems with a focal length in the 1.4mm - 5mm range (the equivalent framing is not relevant to the impact on DoF). Most SLRs have lenses with focal lengths from 35mm - 100mm.

https://www.photopills.com/calculators/dof

(That site has different camera selections purely because the circle of confusion differs based upon the sensor size / resolution, so it's the relative values that you should pay attention to)

Take a gander at the DoF variations for a 4mm versus a 35mm FL system.

This is the reason why iPhones have to implement fake bokeh -- because the depth of field on tiny cameras is so much larger, even with a wide open aperture. But the inverse is that where you want a wide depth of field it is a feature of the size. It's also why people seem to be much more successful taking photos on smartphones, because the focus is much more forgiving.

A wide DoF is a function of those physics.

You should read up on how crop factor works. It just doesn't work out like that. Try a DOF calculator that allows you to choose the crop factor and set a crop factor of 8.4.
I wouldn't call it a "trick" but I suspect Apple is doing some focus stacking under the hood.

The image pipeline in the iPhone gets more and more advanced with every IOS release. The state of the art for computational photography is pretty amazing.

If you're doing something under the hood without disclosing it but calling it something else, it's a trick. It doesn't have to be nefarious, but you are tricking the user into thinking they are doing something which they are not actually doing.
I see where you're coming from, but here's the thing: every single photo taken on a modern phone goes through a pipeline of 10+ stages of image processing, including multiple exposure merging. The iPhone isn't even taking a single photo... it's picking the best frame(s) out of a running buffer of video.

(unless you shoot in raw, and I haven't read enough yet to know what processing, if any, Apple does to ProRes/RAW photos).

Call it "tricks" if you want. I call it using technology to give the non-professional camera user the best photo possible at the time. If that bothers you, pull out the DSLR, shoot in RAW, and spend time afterwards in Photoshop/Lightroom.

edit this is also why apps like Halide (or ProCamera or Filmic Pro) exist... if you want to control more of the options instead of letting Apple choose, the capability is out there. Most users probably don't care. They just want a good photo of their kids to post on Instagram.

How are they not disclosing it? They talk at length, every single keynote, about all the software they build to process iPhone photos.
Do they really? I only ever hear about how its the best iPhone camera they have ever made. Yes, they talk about how their AI is able to adjusts exposure, color tone, etc. Do they actually talk about how a macro is taken in such detail as focus stacking etc? I tend to nod off during these videos, so I might have missed something.
> Yes, they talk about how their AI is able to adjusts exposure, color tone, etc. Do they actually talk about how a macro is taken in such detail as focus stacking etc?

Is that moving the goal posts a bit? Your point was that Apple is somehow pretending they're not using software to create this effect -- if they say they're using AI/etc. to do it, it seems to me like they're not misleading their customers. I don't think the requirement is that they explain exactly how it works in technical detail.

I don't think they did any sort of deep dive on their macro tech, but in the past yes, they have gone into some detail about how their image processing works behind the scenes.

There's a difference in macro being 1:1 ratio (as understood in photography) vs having an AI do something to make something small look big in the image. So if their lenses are not delivering 1:1 but use some sort of algo, then it's misleading.
They tend to have sessions at WWDC about the underlying camera pipeline, for developers who care. Product launch keynotes are the wrong forum for deep technical talks.
that's not what the person I responded to implied. they specifically called out the keynote
DSLRs use extensive such tricks to process the image. Enthusiast groups will show the pathological cases for the image processing that happens. Ultimately, ceci n'est pas une pipe applies to the picture. It's a representation and it is meant to evoke the scene.
What DSLRs use AI or other software based tricks to perform macro photography?
Name a DSLR and it uses software based tricks to perform all photography.
At the risk of feeding the trolls, no DSLR software comes close to the image manipulation of a modern phone. We know this with tools like MagicLantern that would have enabled this type of stuff.

To even equate these as being the same is being disengenious at best.

Specifically, what is 'state of the art' in the iphones image pipeline? Many of these computational techniques (focus stacking, image averaging, subject recognition, face recognition, etc) have been in use for decades - but just not in a handheld device.

By the same token, I wouldn't call Google docs as 'state of the art' since its duplicating existing desktop software, but in a browser (not to minimize their effort, I'm sure its hard).

You said it yourself: "just not in a handheld device" and not in what is effectively realtime.
It's not a software trick. Just one of the unintended benefits of having a smaller sensor.

Full frame sensors have thin depth of field. Small sensors like an iPhone don't have that, so they fake it with portrait mode.

But when you do macro photography, having thin DoF becomes a drawback, so with big DSLRs you have to do focus stacking (which is unnecessary on an iphone).

>Full frame sensors have thin depth of field.

...when they have a large aperture. Stoping down the lens will widen the DoF on that full frame sensor

>so with big DSLRs you have to do focus stacking

you don't have to. only if that is the style you are wanting to achieve. you can also stop down the aperture. it's not as obvious as non-macro, but still something doable.

Have you ever stopped to think about HOW MUCH wider the DOF is when you stop down on a DSLR? Because when it comes to macro, the answer is "usually not enough", even at f/22. And at such small apertures, diffraction becomes a big issue.

This is why focus stacking exists for macro on DSLRs, as when using a true macro 100mm lens you basically have only a thin sliver of usable DOF at reasonable apertures.