Be careful going to a smaller phone, i also thought id prefer a smaller form factor at went from a iPhone 7+ to a Pixel 3 (didnt want XL, like you wanted smaller form factor) and very much regret the choice. Yes both phones have the same screen size, but the larger phone is just more comfortable to use...and plus the iPhone 7/8 plus screen side by side still looks bigger than my Pixel 3.
Just be careful going to a smaller phone, ya the form factor in practice seems reasonable...but you will miss the larger screen and form factor. my 2 cents.