I've had an issue with my Nexus 4 and slow wireless connection. It started happening after a recent 4.3 update.
A few fixes I've come across that have seemed to help are as follows:
1. Make sure your router's security is AES only
2. Make sure WMM is enabled (this applies to my DD-WRT flashed...