So you need to download a program, learn how to use it and risk damaging the .exe. Then you need to redo the whole process every time MusicBee is updated or patched, which is nearly every month. It's the most geeky way but definitely not the fastest.
I'm not even sure tampering with the executable is permitted by the licence.
Edit: I see from your posts that you're coming from Winamp which is dead since 2007 if you don't count that half-baked bug-ridden 2018 version. In that case, changing the icons the hard way may make sense. Luckily for us, MusicBee is alive and well and constantly evolving so don't mess with the executable.