Just got my new Nexus 5 in today and I've got the same issue. Interestingly enough, I'm using a DSL router from 2006, which likely doesn't even support 5ghz. If 2.4ghz is working for everyone else, I've no idea why it wouldn't be working for me.
I've also gone ahead and tested a Nexus 4 and an...