[kromem]

Human brains have a limit on the number of things they can deal with simultaneously called "the rule of seven plus or minus two."

I don't know if you've seen the demo of Gemini 1.5 parsing a video with a 1M context length, but it does things few humans could.

The ability to take all that information and put it into an engine which can identify relationships between data with greater breadth and depth than any individual human will be unfathomably valuable to progress and advancement.

As a trivial example - there's been a number of different diets that have shown success for autoimmune conditions across meta-analyses. But many of the details in the diets are contradictory, such as one being very protein heavy and another being vegetarian. How convenient would it be to ask a model what the common factors are across the half dozen diets that all seem to work?

One day soon it will be feasible for medical trials to do full genome sequencing for participants. Would it be convenient to have a model identify common genes for those where treatment was ineffective vs effective?