Hacker News new | ask | show | jobs
More Low-Bit LLMs (github.com)
2 points by sailajohn 779 days ago
1 comments

This community has launched over 200 low-bit LLMs on Huggingface and they provide tools for full parameter fine-tuning of the LLaMA-3 8B model using a single GTX 3090 GPU with 24GB of graphics memory. Github: https://github.com/GreenBitAI/green-bit-llm