[i_like_waiting]

I was wondering regarding Web3 data, if anyone was succesful to self-host the transactions in some local database.

When I was trying to do that, my local system could keep up only with doing writes, but not much more. What specs you need to have for that? I guess now its like 10tb of transactions in Ethereum, 1m transactions per day.

[ushakov]

Google was

https://cloud.google.com/blog/products/data-analytics/introd...

storing billions of records in database is hard, but querying them is harder

if you want to try, get yourself some proper tools first: https://github.com/blockchain-etl

or you can just query transactions via RPC

[mritchie712]

Yes, it's well into the TBs of data now. Even compressed we're over 1TB for just Ethereum at Luabase (https://luabase.com/, we provide a "data stack in a box" for blockchain data)

[i_like_waiting]

Also if somebody wants to get into this type, I would recommend infura as source of data, or some other similar providers.

[ushakov]

i'd also add alchemy (alchemy.com) to the list