[ajarmst]

I don’t think you can meaningly disentangle “information” and its representation without doing violence to the underlying theory. Nor is a discussion of “symbols” coherent without a reference to the information encoded. Grounding the idea of information in the logical and physical limitations of representation is part of the genius of the theory, not an unfortunate epiphenomenon.