Google Play Services is already closed-source and that’s where the tracking happens. The fact that the base OS is technically open source is usually irrelevant if you have any proprietary Google junk on top of it. But your baseband is allowing you to be tracked too (regardless of the software on the application processor), so it’s hardly possible (certainly not easy) to have any privacy with a cell phone in your possession.