There is no easy way to do this. I don't believe you can turn it off, and even if you could, every picture you take in low light would have a different amount of physical camera movement, so you'd never be comparing "apples to apples".
OIS is often more hype than reality in phones. Although it can be truly useful in some situations, you don't have the control over a camera phone that you would have on a larger camera - e.g., the ability to control the shutter speed. And OIS is completely dependent on shutter speed and how steady you can hold the camera.
The expectation should be that you can not take quality images in very low light. Expect that ANY camera or subject movement WILL cause blurring, and you won't be disapointed.