|
|
|
|
|
by sebastian
32 days ago
|
|
Yeah, I like the ratio framing. That does seem like the kind of experiment you'd want to run next. The thing I'd be curious to separate out is ratio vs density. The fiction examples were positive, but a lot of the tokens are still spent on normal story work. The targeted examples put much more of the training signal on the AI being in the relevant situation and choosing against the bad option. That makes me think the next thing to test is not just the positive/negative mix, but how much of the data is actually about the failure mode. |
|