I was having this issue recently and did some research and couldn't find any solution.
Until today, i was playing around in the options and found out that "Download booster" is on. The moment i turned it off, the grayed out 4G LTE icon is gone. btw, i'm on wifi. It must have been turned on...