In preferences\Plugins i can close\execute minilyrics window. I use to have it always enabled downloading syncronized lyrics, but i now i have most of the lyrics downloaded and think the best option would be toggling ML from a command button easily so you can activate it for a song you are currently listening, and later close it.
Specific wish, probably won't have comments, so people liking this make the efforts of giving +1