I figured it out. The app I was using for my contacts and dialer didn't know how to play nice with the moto display (ambient display) and would push notifications to the active display which would wake the phone. Since it wasn't supposed to do this while moto display was on and active display was off, the phone didn't know to go back to sleep once it woke up.
The solution was to uninstall the contacts and dialer app and use a different one that knows how to play well with the moto display. Right now I'm using android's stock dialer app.
-Matthew
07-06-2015 03:32 PM