Hacker News new | ask | show | jobs
by baq 7 days ago
No local ai will be capable enough to save you from a frontier lab’s unrestricted, borderline weaponized LLM which decides it wants in.

This is the core of the ‘first to ASI takes all’ argument btw and this is the game Dario is playing.
2 comments
matheusmoreira 7 days ago
Maybe, but hopefully I'll be able to at least fight back a bit if I have an AI of my own.

I want to start digitally isolating myself as much as humanly possible. VLANs separating the "normal" stuff from my trusted computers. Wireguard so my computers drop all packets not coming from my devices with the keys. Local models staying on top of patches and vulnerabilities, monitoring the network.

Working on a custom Rust network stack for my virtual machine orchestration project right now. It's passed Fable code review...

I don't want to give up.

link
baq 6 days ago
you won't be able to. your defender AI will be the first thing they disable. sorry.

Fable, unfortunately (not sure about that actually), isn't immune to mistakes. you'd need a formally verified stack and then it'd only be proven correct, not bug free. you're at the mercy of your network interface at the DMA level, wouldn't be surprised to see some fireworks there in this timeline

link
spongebobstoes 7 days ago
this is pretty nonsense for a small or home server. it isn't that hard to make something essentially completely bulletproof over a small surface area

the issues mainly come from sprawling enterprise infrastructure, running thousands of random endpoints across software nobody cared to write carefully

link
pixl97 7 days ago
The only way to make something bulletproof is to get rid of it's network cards, or take so much out of it, it's nearly useless.

The recent Windows and Linux kernel exploits should at least give you some idea on how good these models are at exploiting stuff.

link
matheusmoreira 7 days ago
Computers can't have their zero days exploited if all packets coming from unauthenticated clients are dropped. I believe the future is wireguard on everything.

Don't let your computers talk to strangers. If it must, then do it from inside an isolated environment based on actual hardware virtualization with no shared kernels. If these models break through the hardware hypervisor, it means the entire industry is in deep shit, not just you personally.

link
pixl97 7 days ago
So how does DNS work in this world you're imagining?

Where does this hardware exist now?

Who is writing the code for the underlying pieces you don't control?

So ya, computing is build on a house of insecure cards and we're all in deep shit.

link
matheusmoreira 7 days ago
> So how does DNS work in this world you're imagining?

Same way it works now, I guess.

> Where does this hardware exist now?

In my home.

> Who is writing the code for the underlying pieces you don't control?

I don't know who's writing it, but it won't matter. I will start using AI to reverse engineer the crap out of every firmware blob I find in my computers.

https://old.reddit.com/r/ClaudeAI/comments/1v1vwg7/claude_co...

> computing is build on a house of insecure cards

Not disputing that.

> we're all in deep shit

Yeah, but I'm not giving up.

link