Is the inference running on-orbit or ground-side? I guess SWaP is a major constraint for the former. Not sure if you are using FPGAs or something like a Jetson?
Primary inference runs ground-side (K8s/GovCloud) to aggregate global data for routing. We do see the need for something like a hybrid-edge approach for tactical, sub-5s mitigation. We would target FPGAs (like Xilinx Versal) for production flight hardware to meet strict SWaP and radiation-hardening requirements.