Yep. I have come to love Scrum for the dysfunction it provides as a remote employee. I can sit in the background and do other things while not being expected to achieve anything.
Eyes are watching. Your manager is likely to bring up that you're not an active enough participant in meetings; and yes, it will count against you in your performance reviews.