[priansh]

Mostly mask fill, but Transformers can be fine tuned to downstream tasks relatively easily (T5 was built for translation but is used for autocomplete in many cases)

[gfodor]

would you mind sharing some references (or even just googleable terms) for this process of fine tuning?