I had the same issue also, here is what I did:
I read somewhere that some of the older android OSs had a problem connecting and staying connected to higher wireless N routers. Now my droid 4 phone connects just fine but its on an older OS then the nexus. So I set up a guest wireless account...