|
|
|
|
|
|
by woadwarrior01
90 days ago
|
|
|
Reminds me of Solar 10.7B, which was a very good model for its size ~2 year ago and the "Depth Up-Scaling" technique behind it. Although, that involved continued training after repeating the layers. https://arxiv.org/abs/2312.15166 |
|
|