[a_bonobo]

I work in biology and plopping DNA into GPT-style models kind of works, but there are many long-distance interactions within genomes that are more distant than current GPTs can encode. In some plants there's linkage (~gets inherited together more often than expected) across tens of thousands of base-pairs (~letters), so having these long-distance models will be very useful!