hodsgod has got it.
The option to unsync the Picasa web albums was through my phone's Gallery settings as was stated. I have a Samsung Galaxy S4.
In case those instructions weren't clear enough...
Gallery > Menu Key (bottom left function on phone) > Settings > Accounts (choose gmail account)...