I think everyone who is having issues should report this to Samsung support. If enough people report it, they'll work on a fix. Basically my only other option is to send it to Samsung for repair, but I've had FOUR devices all with the same issues now. I have a nagging feeling if I sent it away I'd just be 3 weeks without my Note and get it back with no real fix. It looks like as of now I just have to make due with using my old BlackBerry Z10 for GPS when it's absolutely necessary (as in going someplace new where I have no idea where it is).
Here is a link to Note 4 support. Click on the link to your carrier's device and click on product support on the right.
SEARCH SAMSUNG
ETA: Funny story, a few nights ago I was on the line with Samsung Support regarding this issue. The rep said he was going to search for any other reports. He then said "I see here that there are others reporting the exact same issue you are. I'm on a site called Android Central..." I broke in and said "I'm pantlesspenguin." His mind was blown lol. Hi James, if you ever see this!