when you choose "Play All Files Shuffled" MB adds all files to the playing tracks queue in shuffled order (by default displayed in the right sidebar).
If the shuffle button is off, the tracks will play in sequence as displayed in the playing tracks list but the tracks in that list are shuffled.
To stop that just reset the queue eg. double click on a file in the main panel