Hacker News new | ask | show | jobs
by Permik 551 days ago
In a way I'm kinda sad that if tokenizers will go the way of the dinosaurs as asking someone to give me a Unicode character from the private use area was one of the last ways you could actually distinguish a co-operative human from an LLM online They simply don't have those characters tokenized, so they can't output them. (But this is technically moot if the LLM has a python interpreter handy)
1 comments

How do you ask someone to give you a Unicode character from the private use area?