Got email from the upstream author who pointed out (and I just confirmed) that once you've started, hit *Settings, *Configure KPhotoAlbum, under the "General" Tab, "Miscellaneous" section, you can uncheck *Listen for Android devices on startup. I believe that for Debian this should certainly default to unchecked.