Well, I don't seem to have an answer why this was happening, but I got some advice about how to finally fix it.
This worked on my Mobile Nexus 5 running Android 5.1
From Ryan Lestage on Google+:
Clear data for the following apps:
Play Store
Download Manager
Google Services Framework
Restart...