[deepakarora3]

All OK except when you need the same level of performance for those 0.001% of requests when the GC kicks in and takes the response time outside acceptable limits. Due to this reason alone, my company is planning to move off a popular Java based API gateway and to a C++ envoy side car implemented service mesh. And I am wondering if this is really worth it.

[throwaway189262]

Consider trying ZGC first. The main selling point is low worst case pause time. I've seen some tests where P99.9 pause time was less than 5ms, vs several hundred for older collectors.

In my limited tests I never saw a GC pause over 5ms. I was basically hammering a Spring Boot application with HTTP load tester.

[pkolaczk]

GC doesn't need to pause to have a negative effect on application latency.

While not-pausing is generally a huge improvement (after several decades of GC development), now what about thrashing of CPU caches?

[sideeffffect]

Shenandoah might help you. See my other comment for more details:

https://news.ycombinator.com/item?id=24571054

[zmmmmm]

They should definitely investigate the new low-latency gc options in the JVM.