[kazinator]

C preprocessing is token-based. The input is decomposed into preprocessor tokens, sequences of which are then manipulated.

There are issues with using stand-alone implementations of C preprocessing like GNU cpp with languages that deviate from C in their token syntax.