As it states here you can change this right from the Hangouts app!
When you open Hangouts, select the menu, then click settings. From there, select your account, and the first option should list "Profile Photo". From there you can either take a selfie or choose from the gallery!
Hope that helps!
Yep, when following your steps. That button will require me to upgrade to Goggle+ in order to upload a image.