Hacker News new | ask | show | jobs
by bravura 1041 days ago
Does it support Metal / MPS acceleration?
1 comments
SOLAR_FIELDS 1041 days ago
I’ve gotten mine running with FastChat - they have a Metal/MPS option.

Sadly 7b is not very good for SQL tasks. I think even with RAG it would struggle.

link