You are certainly not building "everything" yourself. You are drawing a line just like OP, that where you draw that line is different than theirs is not at all surprising.
I actual do “build" most thing - typing ./config && make && make install is not too hard, but I do think there is real value is building/installing your own tools beyond just the cost aspect.