Hi, welcome to the forum!
Are these mp3s? Check with the tag inspector that there are not ID3.1 tags hiding in the files.
This shouldn't be related, but you don't actually need the compilation flag set if you have Album Artist written to the file. The only thing it does in MusicBee is automatically assign an album artist according to the rules in sorting/grouping preferences (and only if you have that setting activated).