[masterj]

It sounds like you should look into their tail-sampling Refinery tool https://docs.honeycomb.io/manage-data-volume/refinery/

[phillipcarter]

Yep, this is the one to use. Refinery handles exactly this scenario (and more).