A
If you progressed to a new video from the suggestions list in the current video or used a playlist, you can tap the screen to bring up the controls, then tap the left arrow to go to video you were just on. Otherwise yes you do have to go into your history.You can't. Only if you use your History section and select the video you want.