Hacker News new | ask | show | jobs
by benhalllondon 1381 days ago
I played around a bit and found out dropping the tokenisers version to 0.11.6 worked

`pip install tokenizers==0.11.6` first

1 comments

That worked thank you!