Hacker News new | ask | show | jobs
by prism56 6 days ago
How do you know it swaps to ram vs on the TPU?

Would be interested in testing this on my pixel.

1 comments

Because TPU has 2GB and weight + context needs more