Figured it out! Open the photo you want to make as the album cover, take a screenshot of it, and then move the screenshot (from the Screenshots album) to your album.
I guess it makes whatever is the newest created file in the album as the album cover, so this seemed to work as a workaround.