Stochastic Weight Averaging (Izmailov et al 2018) https://arxiv.org/abs/1803.05407
Latest Weight Averaging (Kaddour 2022) https://arxiv.org/abs/2209.14981
Latest Weight Averaging? (Sanyal et al 2023) https://arxiv.org/abs/2311.16294
Cyclic Learning Rates (Portes et al 2022) https://arxiv.org/abs/2206.00832
Exponential Moving Average? (Zhanghan? et al 2019) https://arxiv.org/abs/1909.01804