Private sessions are my solution for branching out. Still a pain, and shouldn't happen. Google Play Music did this really well and for me, even with its issues, was miles ahead of Spotify.
i instinctively turn on private mode every time i open spotify on my desktop. i really wish it worked the opposite way, have it turned off all the time and then turn it on when you want spotify to build up new recommendations for you