[roseway4]

Running neo4j on reasonable hardware (& depending on graph size), approximately 70% of the latency is calling OpenAI's embedding API. We've seen latency up to 750ms, for just the 3rd-party API call. :-/

As a result, we host embedding models on rented GPUs and get a P90 latency of 10ms.