[astrange]

You don't have to teach an transformer model using a language corpus even if that was the pretraining. You can e.g. write algorithms directly and merge them into the model.

https://github.com/yashbonde/rasp

https://github.com/arcee-ai/mergekit