You are totally right. I have noticed that I get better battery life with only 2G instead of the 3G/4G radio. Email, SMS, Facebook, and RSS readers work really well on 2G, so for big chunks of the day I'm just on EDGE and not really noticing it.
I should try leaving the 3G/4G on during the day...