Yes, sometimes you have to for email confirmation etc. but it is rare.
Most mails from my bank is 'You have a new message, login to home bank to read it'.