I would definitely recommend deleting files through MusicBee - in this way all the library and any playlist entries will be removed.
Deleting files with Windows Explorer (or similar) will leave you with further work to do to clean up the MusicBee database and, while the library entries are fairly easy to deal with, playlists can get a little messy.