[wfalcon]

this is also what our (Lightning AI) lit-gpt library does. https://github.com/Lightning-AI/lit-gpt

[jamesblonde]

Thanks, hadn't seen this.