I have exactly the same problem with the Galaxy Note 4. The clock widget freezes. If I remove and re-add the widget to a screen, it never comes up, the space where it should be is blank. If I reboot the phone, it then works (for a week or so).
I dont have any battery saver apps or similar...