Hacker News new | ask | show | jobs
by IanCal 981 days ago
This is called feature engineering if you want to look up more of a history and use of this idea.

Edit - tokenising is a form of this, you're pre-transforming the data to save it having to learn patterns you know are important.