I dont know what you mean by "Locating album in explorer", but in any case MB wont be updating any files when locating files. Perhaps you are looking at the last accessed time rather than the last modified time
I have a shortcut key set for "General: Locate Selected Track in Windows Explorer" which is what I mean by "Locating album in explorer".
I'm not looking at the last accessed time, please see the below screenshot.
These albums all had their "date modified" changed to the current time when I used my hotkey with the album selected, but without any specific track selected. I also managed to spot a file (I guess temp file?) appear then disappear inside the folder once when doing it. I guess MusicBee generates a file in order to open explorer, then deletes it? I really don't know why this is happening, and it doesn't even happen 100% of the time, but when it does it's somewhat annoying considering nothing is actually being modified.