Download Manager Issue on Nexus 4 !!

[cognossaint]

I am new to smart phone world and was trying to download a spreadsheet from gmail. It was showing up in the notifications section on the top that the the file is being downloaded. I decided to disconnect as i did not want to see this document at that time. Since then the notifications window shows this file as downloading but it doesnt download it. If I press and hold to go to the App Info, I will be taken to Download Manager. I have to Force stop the application to stop this notification. However, after this I wil not be able to check Play Store etc.. so, i have to go back and reset the App preferences. As soon as I do that, the downloading notification appears again. Its starting to get creepy. Restarting the device hasnt helped. Clearing the Cache from Download Manager and Quick Office has also not helped. I m not having issue with downloading new files and opening them in Quick Office, but this one file seems to be just hanged in there. Any suggestions would be greatly helpful !!