I am having the same issue and have come to the same solution: restart the device. This is not an ideal solution either. I have tried closing the app I am using, turning the wifi off an on again, turning airplane mode on and then off and none of that has worked.
I have 3 Chromecasts on a Google...