Hacker News new | ask | show | jobs
Simple AI Token Profiler / Debugger (profiler.getrekon.com)
3 points by TreDub 18 days ago
2 comments

We made a simple profiler to help optimize AI token spend. Generally speaking anytime you want to optimize your app, whether it's for memory or otherwise you typically start with a profiler. There are a ton of MiTM Gateways but there aren't many true profilers, so I thought I'd make one. Just sign up, create a "system", instrument it, and watch. Great way to see where your tokens are going.
We added a comparison mode today so that you can see how your system reacts to the same prompt with different tools!