Hacker News new | ask | show | jobs
by scosman 16 days ago
Google's QAT claims to need 6.7 GB RAM, vs Unsloth's dynamic quants at 8GB. Would love to see some benchmarks. Both amazing for size.