Unfortunately it seems to just be an issue as there are no settings to adjust this within the App. I've came across threads on other forums as well with no solution. Disappointing as I tend to watch a good amount of video on my phone, especially now considering how great the battery is on the Pixel 5.