I just found another possible answer!
The problems starts when I repeatedly switch my Chromecast to some different network WiFi. Then ended up with the Chromecast wouldn't able to cast any from my devices. The Chromecast was able to connect and set-up, but the cast button won't appear in the...