Under Preferences> General> confirmations
there is a secondary option for 'confirm removal of files from playlists' that says 'include option to permanently delete the removed files'.
If the second option is un-ticked, you only get the confirm file removal of files from the playlist dialogue.