|
|
|
|
|
|
by storystarling
146 days ago
|
|
|
Makes sense regarding the MoE performance. I am not sure the cost argument holds up for high volume workloads though. If you are running batch jobs 24/7 the hardware pays for itself in a few months compared to API opex. It really just comes down to utilization. |
|
|