|
|
|
|
|
by djwjjtw
81 days ago
|
|
The real story here is replacing Ray Core's actor task dispatch with direct gRPC for the hot path.
Essentially admitting that the general-purpose actor model was the bottleneck for inference
workloads. Smart move — let Ray handle orchestration and get out of the way for actual data flow. |
|