I live in an LTE fringe area but usually get constant LTE on the second floor of my house. The plummet has occurred with WiFi on and data turned off.
However, I have also had the plummet happen while downtown with very strong LTE and WiFi off. For me, it doesn't seem to make a difference...