[moochee]

Thanks. LoftQ = Quantization + LoRA fine-tuning. What's the difference between LoftQ vs QLoRA then?

[tourzhao]

LoftQ = Quantization optimized for LoRA + Better LoRA Adaptor initialization + LoRA fine-tuning.