[hwoolery]

I created an app that uses ARKit + Machine Learning (CoreML) called InstaSaber that projects a virtual lightsaber out of a piece of rolled up paper: http://instasaber.com/

It was more a proof-of-concept of the technology I'm working on, but I think it's worth checking out (it's free to download). I think you will start to see a lot more cool implementations of ARKit/ARCore that integrate with CNN's and do new and unique things.

Edit: 20k downloads in first week, I haven't bothered to market it though.

[dharma1]

That's dope! Feature idea - multiple "lightsabres" in the same frame with collision detection with sparks/sound FX. I can give you the gfx/sound assets if you need :)

Used to make little films with my kids using After Effects - here's one - https://youtu.be/IRyy2BhbuaU

They love it but it's quite slow and painstaking. Instant AR version would be amazing.

[hwoolery]

Many people have requested dueling, but there's a few technical hurdles there : ) Nice work with your kid!

[rambossa]

So sick. Any insight on the ML models/training?

[pks016]

Hi, I have seen your app before, when you released it. (from reddit I guess)

Are you planning to release it for android? or any similar apps for android ?

[hwoolery]

I would love it if I had the time and resources to do that, but hard to justify with how poor the retention was on iOS (understandably, from a gimmick like this). Quite a good chance I will be targeting Android first next app I do.

[pmtarantino]

Not related with the original question, but your landing is great. No text and in just 2 seconds I understood what your app does.

[hwoolery]

It's such a dumb idea it doesn't need much explaining, haha

[billconan]

how ARKit is used in this case? Isn't ARKit for detecting plane objects?

[hwoolery]

Essentially, just using it to feed frames into the CoreML model, but not using the planar detection. However, I am using ARKit world orientation tracking in other stuff I'm working on like this: https://twitter.com/2020cv_inc/status/969628227130949633

[billconan]

oh, for rendering I guess

[hwoolery]

yes, that as well