Nexus toolkit will downgrade and then root for you. It's easy and downloads everything it needs and then runs everything automatically. You can't mess it up.
I have 5.1.1 on my N7 2012, and per a youtube video, this seemed to help the speed a lot: Under settings, enable Developer Options, then under Apps, change Background Processes Limit to none.