I'm somewhat involved in similar apps and I know the computation required, even for just inference, can be quite expensive.