Thanks for the idea. I can't take the battery out of my Xperia Z1 compact but I turned it fully off and then back on - no change, I'm afraid.
Can I see in the photos app which photo hasn't completed it's upload yet? Then I could delete or put somewhere else, in case it's just the one photo...