[ssheng]

FastAPI is great building block but can't expect it to work for model serving out of box.

[beckingz]

Load your pickle file and it works?

[beckingz]

I know, pickle is insecure, etc

[chaoyu_]

Most team don't really concern about the security side of things when using pickle for model deployment, more about performance and resource utilization. It works ok for very light weight models, but doesn't scale.