[sailajohn]

This community has launched over 200 low-bit LLMs on Huggingface and they provide tools for full parameter fine-tuning of the LLaMA-3 8B model using a single GTX 3090 GPU with 24GB of graphics memory. Github: https://github.com/GreenBitAI/green-bit-llm