So I was finally able to get my Nexus 4 Google wallet to work. I use T-mobile pre-paid.
To be honest, I am not sure what exactly fixed the problem, but I will walk through what I did. (I have a hunch of what the answer is though, and if it is that, people will shoot themselves for it being so...