A small flip phone with an e-paper screen could easily have a battery big enough to provide a useful wi-fi hotspot, especially if it is designed for that purpose.
Really, what we want is a pocket LTE wi-fi hotspot with a screen that flips up providing access to a dial pad, mic and speaker...