I want to be able to experiment with tweaking model weights and seeing the outcomes and i want to be able to finetune open source models. What's the best way to experiment with that without breaking the bank?
If you want to experiment with fine tuning small models, you can actually do that with free Google Colab instances. Unsloth.ai has written a bunch of guides on this.