[hereonout2]

Yes this is very interesting!

The hardware, tooling and time required to do a LoRa fine tune like this are extremely accessible.

Financially this is also not a big expense and I assume would have cost in the order of $100s of dollars in GPU rentals, possibly less if you ignore experimentation time.

So what is a barrier to entry here? The data? Well they didn't have that either so automatically generated a dataset of just 500 examples to achieve the task.

I'm sure they spent some time on that but again it doesn't sound an incredibly challenging task.

It's worth realising if you've not delved into fine tuning llms before. In terms of time, scale and financial costs there is a world of difference between building a product like this and building a base model.