Much is still being said in person or calls, because talking is much more efficient than writing, so ... no, we don't "have proper record of everything said and done."
Whether we should have that record or not is completely orthogonal to the conversation about how remote workers force (or not) the others to behave in a certain way to accommodate the remoteness of these workers.