Reset settings and reset network settings(not factory reset) and now I have 2 speakers working for the first time since I bought the phone about 2 months ago.
I dont know if this helps, but I literally found this out about 5 minutes ago. If I cover the sensors to the left side of ear speaker, the ear speaker turns off until I uncover it. It might be a software issue tied to whatever sensor that is.
Additional Info: covering that censor cluster shuts off the speaker for YouTube and spotify. I'll update the list as I try it with more apps