The Music tab is a simple, hierarchical browser, using your library.
The Music Explorer tab adds online information content, and provides a means to explore further music by a selected artist, and offers suggestions for similar artists. It allows you to 'explore' music based on what you have selected, or are currently playing, both in your own library, and elsewhere. Its meant to provide a 'if you like this, you might like this' function.