[Seattle3503]

What technique do you use to get BERT to work on longer documents?

[hdhshdhshdjd]

512 has been sufficient to solve my problems. I had done some initial attempts with BigBird that weren’t going well, but then realized I didn’t really need it.

I may revisit at some point.