This is totally customizable and the house numbers are already present in the original data, it's just not displayed in the default styles. You can customize the style by using the Maputnik editor, house numbers are visible in the "Inspector" view.
https://maputnik.github.io/editor?style=https://tiles.openfr...