Hacker News new | ask | show | jobs
by astrobiased 355 days ago
It would need to be more than that. A prompt for one model can have different results vs another. Even when the model has different treatment for inference, eg quantization, the same prompt for the unquantized and quantized model could differ.
1 comments

Even more so, when you come back to understand in a few years, the model will no longer be available
One of several reasons to use an open model even if it isn't quite as good. Version control the models and commit the prompts with the model name and a hash of the parameters. I'm not really sure what value that reproducibility adds though.