|
|
|
Show HN: Standardising 'Unit Tests' for Prompts
(github.com)
|
|
3 points
by Jonverrier
448 days ago
|
|
PromptRepository is an open-source framework (Typescript) that illustrates an approach to creating more reliable LLM-based applications through systematic prompt validation, and testing. Key features: - Simple JSON schema for externalized prompts with versioning and parameter validation - Lightweight approach inspired by Anthropic's guidance to "keep it simple" with LLM applications - 'Unit tests for Prompts' inspired by Chris Benson/Practical AI's recommendations from episode 295. - Bundled prompts to generate unit tests and evaluations for new prompts built with the framework. The framework demonstrates a novel approach: bundle tested prompts with a framework that generate code to use the framework. Repo: https://github.com/jonverrier/PromptRespository Take a look. |
|