Y
Hacker News
new
|
ask
|
show
|
jobs
by
inChargeOfIT
917 days ago
It sounds like the same requirements as a 70b+ model, but if someone manages to get inference running locally on a single rtx4090 (AMD 7950x3D w/ 64GB ddr5) reasonably well, please let me know.