I've tried to reproduce what you're experiencing, but to me it doesn't work that way. It works just like it should and how you want it to work.
Can you give us Before+After screenshots, so we can see what's happening?
Also, the panel is sorted by which tag?