Hi, welcome to the forum!
You could technically do this with the Additional Tagging and Reporting tools plugin. If your albums or artists are getting split up due to featured artists, though, you should probably look at what you're doing with album artist. The whole point of album artist is to have a consistent artist for an album so that you can put individual track artists in artist and not have this problem.
Another option to keep your feat artists as artists is to use MusicBee's custom sorting feature. It will allow you to tell MusicBee to sort a feat b, a feat c, a feat d all under a, ignoring the rest of the tag.