Figured it out. Plugged the phone into my laptop and went hunting through the phones directories.
Internalstorage>Pictures>cache>com.google.android.googlephotos
Then deleted all the picasa-cache directories. That's it.
Sent from my Nexus 5 using Tapatalk