Hacker News new | ask | show | jobs
by veilgen 453 days ago
This looks like a powerful step toward making prompt engineering more scalable and production-ready. The version control approach, along with staging environments and real-time analytics, seems particularly useful for teams handling high-volume AI workloads.

One question: How do you handle prompt drift over time? As models evolve, prompt effectiveness can degrade—do you provide any automated testing or monitoring to detect when a deployed prompt needs adjustment?

Looking forward to exploring Portkey’s capabilities.

1 comments

thank you! we don't have a strong Evals module within our Prompt Studio at the moment. So there's no straightforward way to do that. however, we do have one of the better modules for applying guardrails on live AI traffic and setting up routing based on guardrail verdicts: https://portkey.ai/features/guardrails