[ummonk]

I don't see why the transformer architecture can't be designed and trained with separate inputs for control data and content data.

[amw-zero]

Give it a shot

[vrighter]

because it's all one (unexplainable) matrix of weights.