Hacker News new | ask | show | jobs
by zaking17 879 days ago
How would you handle schema migrations in a system like this?
1 comments

It depends on the layer, some of the layers might be able to take advantage of how the data is persisted. For example, if you use avro/protobuf, the decoder will handle it for you. If that's not the case, you would have to implement the migration by yourself. There is a paper[1] on this subject called "Online, asynchronous schema change in F1", which explains how to implement it.

1: https://dl.acm.org/doi/abs/10.14778/2536222.2536230

thanks, i'm really enjoying that paper