[creatonez]

Why do you think Bing Chat is going in a slightly different direction and not using this format exactly?

Their prompt - https://old.reddit.com/r/bing/comments/11bd91j/release_of_th...

Wouldn't it be better to unify around ChatML, for the sake of all future training data being consistent? I thought it was strange that they used <|im_start|> but not the rest of the ChatML syntax.

(There is always the possibility that they are using it, but the AI has hallucinated a slightly different syntax when repeating it)

[shepardrtc]

Microsoft has always been very siloed. They want to do their own thing with it - as evidenced by the pile of hot garbage they've turned it into.

[notamy]

I'm VERY curious about those "#inner_monologue" sections...

[gs17]

Looks like it's just getting it to "show its work" to improve the output.

[int_19h]

Telling ChatGPT to "think it out loud" first before giving the final answer generally leads to better results than just telling it to answer right away. This is especially true in multi-step tasks where you keep adding to input.

[rentnorove]

Platform lock-in. Interoperability would not only be more costly in terms of the work to design and agree on a common standard, but it'd also makes it easier to switch to a competitor.

[creatonez]

> but it'd also makes it easier to switch to a competitor.

Thing is, the end user never sees this implementation detail, so it only matters on their side.