It looks like there is a quick toggle for it as well in the notifications bar.
Has anyone found how to turn the multi-window app off, other than manually closing it?
Okay, never mind. Had tried before and it didn't work, but long pressing the back button turns it off.