So, I just reset the UE Boom with the Power and Volume Down buttons, it fixed the incorrect volume pairing issue. Who knew a simple reset would fix that?! Crazy.
But that doesn't seem to help your current situation sorry if you are using a different speaker and it is still persisting.