|
|
|
|
|
by mnahkies
806 days ago
|
|
I'm a big fan of big query as well, but the cost can be problematic if you're not careful. Generally speaking I've found it manageable if you make good use of partitioning and do incremental aggregation (we use dbt, though you have to do some macro gymnastics to make the partition key filter eligible for pruning due to restrictions on use of dynamic values https://docs.getdbt.com/docs/build/incremental-models) It's also important to monitor your cost and watch for the point where switching from the per-tb queried pricing model to slots makes sense. |
|