[hunterbrooks]

100ms is crazy fast. Approx what's the split b/t the embeddings calls and the graph traversal work (the library stuff)?

[roseway4]

Running neo4j on reasonable hardware (& depending on graph size), approximately 70% of the latency is calling OpenAI's embedding API. We've seen latency up to 750ms, for just the 3rd-party API call. :-/

As a result, we host embedding models on rented GPUs and get a P90 latency of 10ms.