[nicktorba]

There seem to be a lot of components like this that need to be developed.

For example, there are plenty of tools to create ML model endpoints (send data, receive prediction) but many times, those models are not customer/user facing. They will be hit by some other program/system (often on a regularly timed schedule).

One solution is to embed the model in the application that needs the predictions, but this can get hairy when it comes to updates/maintanence/etc.

Over the next few years, we will see some generalized "model invocation" components that integrate with common data sources for these use cases.

You can see an inkling of this with the seldon-core kafka integration: https://docs.seldon.io/projects/seldon-core/en/stable/stream...