Y
Hacker News
new
|
ask
|
show
|
jobs
by
salamo
9 days ago
Yeah, the model is small enough that inference is already basically instant for my usecase (only 6 transformer layers for the blog search).