Hacker News new | ask | show | jobs
256K context with 72MiB of KV cache on the GPU (github.com)
3 points by GreenGames 46 days ago