Hacker News new | ask | show | jobs
by kenarsa 744 days ago
GitHub: https://github.com/Picovoice/picollm Platform: https://picovoice.ai/blog/picollm-local-llm-platform/ LLM Quantization Algorithm: https://picovoice.ai/blog/picollm-towards-optimal-llm-quanti... LLM Inference Engine: https://picovoice.ai/blog/picollm-inference-engine-for-x-bit...