I'm on an LG G3, with the same issue. Hopefully the below works on all phones.
After trying all sorts of hacks and spending quite some time on the phone with Verizon tech support, I found this simple answer in a Verizon forum, and it worked for me:
My Verizon website > Change Features > (Remove) Visual Voice Mail Basic -> rest of process on web page to finish up changing features.
I restarted my phone, and now all the voice mail icons/links go to regular voice mail.