"Automatically sweep and organize new files" is applied when a file is first added to MusicBee (thus, new), but won't do anything to files already added. It can be applied to the inbox as well as the library.
Auto-organize continuously organizes files in Library/Audiobooks/Video, but not the Inbox. If tags used in the organization template change, the filename or path is automatically changed.