Yes, that's the "natural order" of the playlist. If you want to reorder a playlist, you can sort it by whatever fields you want (like Artist + TItle) and then use the List menu to update the play order.
There's a pretty thorough page on playlists on the wiki.