[bomewish]

There's a C++ library for tokenising Chinese for sqlite FTS: https://github.com/wangfenjin/simple