[btwillard]

Yeah, and our addition to all that is to almost completely remove the cost of determining the next valid tokens on each step.