It could be that the Nexus will adjust volume via the rocker switch if it is pressed even when the display is off. Mine does this all the time in my pocket. What I ended up doing was getting a case with cutouts for the rocker switches so they weren't exposed but recessed in the case. This helped a lot.