[skjoldr]

That looks like "if confidence < %some number%, then try to expand the dataset using known related sources". Load a library of short book descriptions into such an AI, and it should reproduce this behavior. Though it also needs the capacity to learn. Otherwise you could put a snippet that automatically queries it for better materiel about the subject when its confidence is low, so it just tells you where it thinks you should look. That seems doable now.

[skybrian]

I'm no machine learning expert, but agree that it seems doable. I think rather than an if statement (which seems like a bit of a hack), it would be more principled to somehow train it on when it's worthwhile to do a search, sort of like a multi-armed bandit problem.

Either way, it's not just scaling up, it's changing the algorithm.