You didn’t overlook anything, the feature is extremely frustrating.
Worse, if you download a photo from a vault to your download folder, it will be re-uploaded to your automatic photo vault, generating duplicate files.
All of this could have been solved by allowing the user to choose one or more folders to allow automatic uploads from. Even the choice between 1 folder and all folders would be a massive improvement.