Ok, I see. I had to create new tab, pin the panel to it and move it all the way to the beginning. This one remembers the stuff. Not sure why it isn't a default behavior for "Playlists" panel by default. I mean, wouldn't that be a desired, preferred behavior for large majority of users?