Hacker News new | ask | show | jobs
by imshashank 743 days ago
Wow, so it's possible. Any idea how are they doing this?
1 comments
jaggs 743 days ago
Maybe a really tiny LLM? Like this? https://huggingface.co/openbmb/MiniCPM-Llama3-V-2_5-gguf/blo...

[Edit: just checked Reddit and it's apparently a 3B model (phi 2)]

https://www.reddit.com/r/LocalLLaMA/comments/1bpw9c7/running...

link
imshashank 739 days ago
Interesting, thanks for sharing.
link