[helpfulmountain]

Yeah this speaks to the fragility of current machine learning techniques. It wasn't trained to play handicap go, so it's quite bad at it.

Similar to what is being called hallucination in LLM area

[thmt]

Nit: KataGo does train on handicap games up to 5 handicap stones. In the KataGo write-up "Accelerating Self-Play Learning in Go" from 2020, Appendix D says that KataGo trains on handicap games with up to 3 handicap stones. Looking at the current version of the KataGo code, nowadays it trains with handicap up to 5.

[BlueTemplar]

How would a pro fare that never played handicap go ?

[scott_w]

Probably the same way top 10 GMs do giving Queen odds. They’ll still stomp most lesser players.