The area you can click on to change the time in the sidebar player from total time to time remaining is nearly twice as wide as the actual time display, generally. It can even overlap the player controls, which makes it WAY too easy to switch by accident. At minimum width, you can't activate the Next button at all because the time control covers it up. I think unless your mouse is directly over the time, it shouldn't trigger a switch, but at the very least the player controls should take precedence. In this screenshot, I can click in the middle of the Next button and trigger the time switch.