[NitpickLawyer]

> gemini explicitly told me

Do you mean someone from the gemini team? If you "asked" the LLM then it's likely a "hallucinated" answer. They say all sort of things about "themselves" only because they were trained to do so. They likely have 0 knowledge about their true architecture.

[shwouchk]

this might be true in the future. right now a lot of the “architecture” is directly built into the prompt.

even in the future, the model that is directly responding to you will likely have to know some details of its architecture to be useful.