|
|
|
|
|
|
by dagmx
552 days ago
|
|
|
Inference costs per invocation aren’t high. Scale it out to billions of users and it’s a different story. Training is amortized over each inference, so the cost of inference also needs to include the cost of training to break even unless made up elsewhere |
|
|