That's one tough decision to make. Frankly, the best way to decide is to visit the Verizon store and physically use the devices and see which fits the bill. You'll have to wait to use the Note 3, but that won't be very long (at least you hope not). You can always visit another carrier when it gets released since the device is essentially the same minus the added apps specific to Verizon.
Even though it was starting to show it's age I was still pretty happy with my Motorola RAZR Maxx until it fell off of my Harley at 85 mph. If that wouldn't have happened I probably would have waited another release cycle or two before I upgraded.
That being said I really like the S4, and I've had no problems with it at all.