Hacker News new | ask | show | jobs
AnyLanguageModel: One API for Local and Remote LLMs on Apple Platforms (huggingface.co)
4 points by _mattt 205 days ago
1 comments

Author / creator here. I built this because integrating LLMs into Swift apps meant juggling completely different APIs for MLX, llama.cpp, CoreML, Ollama, and cloud providers. AnyLanguageModel gives you a single interface modeled on Apple's Foundation Models framework.

GitHub repo here: https://github.com/mattt/AnyLanguageModel

Happy to answer questions about the implementation or trade-offs we made.