Thought I would share with those who didnt know, I was able to remove the persistent Android Wear Connected notification by long pressing on the notification and under "App Info" unchecking "Show Notifications" box. I found doing so removes the persistent notification on my phone while still sending notifications to my watch. Also I am using a Verizon G3 and am not rooted.
Hope this helps someone!
Hope this helps someone!