Hacker News new | ask | show | jobs
by LinasKo 913 days ago
It has to be the auto-playing Tomb Raider agent, where LLMs were used to give Lara self-awareness. I've never seen anything like it.

It starts off with some classical computer vision shenanigans to understand the character movement, map layout, and to create the 'desire' to explore. Then the LLM is given input of images, sound descriptions and prior thoughts, lettting Lara remark on the situation, which feels very surreal and, at least for me - very unexpdcted. E.g. she hears the wolves howl and wonders how they survived in this environment. Or meta-remarks on game music changes.

https://youtu.be/0wTf_bbkW2U?si=tsWJpyLrRpRDSXD9

3 comments

Worth pointing out that most of that video is fake[1]. Though it and its debunking video are still a great example how to make entertaining fictional content with a little help of AI. It probably won't be too long before somebody builds something like that for real, similar AI mods[2] for Skyrim are already out.

[1] https://www.youtube.com/watch?v=bmqUUb80ApQ

[2] https://www.nexusmods.com/skyrimspecialedition/mods/98631

The description says its faked?

> This video may be inaccurate and is made for entertainment.

I'm watching it now, it's quite entertaining. But there are quite a few comments on YouTube suggesting it's a hoax?