I would say your problem is so simple. Because I've just experienced same problem. My problem was that my AP was set to channel 13 and it looks like Nexus 5 isn't able to connect on this channel (it is same with channel 12).
Try to set your AP on another channel, it may helps.
Facebook
Twitter
Instagram