|
|
|
|
|
|
by nbardy
844 days ago
|
|
|
No these things just take time. There is no conspiracy again efficient training. Companies aren’t going to lower compute budgets with more efficiency. All the top labs are increasing efficiency, but they are using that to get more out of their large runs not spend less. Most companies have a relatively fixed training budget for their large runs and are trying to get the most out of it, bot save money, Mamba is actually being scaled up and tested across other fields(bio) at a rapid pace compared to other architectures |
|
|
Fwiw, the OP isn't suggesting conspiracy. The notion is more about convergent thinking.