Hacker News new | ask | show | jobs
by arcanemachiner 20 hours ago
The idea itself is sound: If you can reduce the signal-to-noise ratio in the context window, then that's a good thing.

Whether or not RTK actually does this has not been established. I would be glad to see some proper benchmarks done on the actual difference this tool makes (not some meaningless "up to 90%" type of language).

2 comments

I was wondering if that impacts the accuracy, obviously the rtk output wasn't in the training dataset, but maybe it doesn't matter at the end
I found this, which has some: https://arxiv.org/pdf/2605.28876 TLDR: RTK does not look good according to the author's benchmark.