Thanks for pointing this out... Quite some progress has been made in making BB safe, but I am still encountering new things along the way. Let me study how to address this in the next finetuning.
I hope I haven’t discouraged you in any way. I love the idea, I’m not really sure how hard it will be though. I think this is why we see those hard guardrails on the openAI models, but they really make the model less useful in as many ways as they make it “safer”. It might be like trying to make a “safe” axe. If it’s safe, it may have much less utility.
My project is somewhat intersectional to yours in some respects, and I have no idea how to overcome this issue without hard guardrails.
I’d love to see you succeed with tuning! That would certainly give. me some hope!
My project is somewhat intersectional to yours in some respects, and I have no idea how to overcome this issue without hard guardrails.
I’d love to see you succeed with tuning! That would certainly give. me some hope!