I am having the same problem as well with my Galaxy S6 Edge.  For example, I have a contact from Google, Facebook and LinkedIn linked.  Their LinkedIn page doesn't have a photo and it is making that the primary and I want to switch it to the Facebook that does have a photo but haven't figured...