Hacker News new | ask | show | jobs
by reverius42 700 days ago
How does the GPT-2 tokenizer deal with non-text input? This dataset is multimodal but I thought GPT-2 was text only.