Hacker News new | ask | show | jobs
by Zee2 333 days ago
> a ∼3B-parameter on-device model
2 comments
ThomasBb 333 days ago
There are even already some local AFM to Open AI API bridge project on GitHub - that lets you point basically any Open AI compatible client at the local models. Super nice for basic summarisation and completions.
link
JKCalhoun 333 days ago
I was worried "device" was a Mac mini, not an iPhone. (I already have been running models on my MacBook Pro.)
link