Unfortunately I merged 2 problems into this thread so maybe it is my fault because at first I was wondering why the new location would be a new file. (Answer: statistics are not embedded, alright okay)
But then I realized that just moving a file inside a "picture folder" inside an album folder, was triggering the folder as a new folder because of just moving a file inside that folder
So it's like it's "file sensitive":
It's interpreting a "date modified" attribute as a Date added, okay alright, I'll stop arguing about that, now that I know it's doing this behavior, which is "anything is date modified, there is no date added except when the addition of a folder to the library"
Okay, alright then