alright, so I guess I discovered the problem
I am used to put all my files in the monitored folders to go to the inbox, where I edit the tags and then send them to the library
So it's in the Inbox that mp4s are actually considered audio files (since Inbox is in common for all the files)
Then when I send them to the library under the Video node, it's all normal and they act like regular video files