The A-Z jumpbar looks at the first letters in the sort field, so it's not going to work well with path because all paths will probably start with the same letters (drive letter, folder name, etc).
If you sort by Artist, Album Artist, Album, etc, it should work fine.