Y
Hacker News
new
|
ask
|
show
|
jobs
by
nice_byte
120 days ago
Yeah I misused the term "token". What I really meant is that they should just be token separator and nothing more (i.e. once we encounter whitespace it means the current token has ended)