Cutting and stacking(or picking up/delivered), the space to store it, having to carry it into the house, emptying your ashbox, having to actual start the fire, etc.
But man oh man it is hard to beat the ambiance. I have heated exclusively with wood for the last two winters and completely agree with your comments but I wouldn’t trade it for anything.