[imtringued]

Gemma 3 has some layers with a context size of 1024 tokens and others having full length. You need to read the Gemma technical report.