As someone mentioned above, I'm looking at this as a harbinger of things to come with the Note 5. I can deal with the lack of an SD card, which I now use almost entirely for music. With the advent of larger internal memory on the Note 4 -- and KitKat throwing a log jam into the manipulation of files on the SD card -- I store pics and videos in internal memory to allow for easy manipulation (generally, deletion). And because all of my music is stored in Google Music, I usually use the Play Music app more often than not, making the SD card storage of music redundant.
But what I can see having a difficult time with, though not all of the time, is the lack of a replaceable battery. In my normal routine, I don't need a replaceable battery because I'm always near or about to be near a power source (home, car, or office). But as a general matter, when I'm traveling, say, on vacation, taking the kids to Disney, what have you, I'm often out and about all day. At those times, I always take an extra battery, which I invariably end up popping in at 5 in the afternoon or so. It's pretty clear to me that if I get a newer phone, I'm either just going to have to let the battery die in such instances, or I'll have to carry the adaptive fast charger with me and take 10 minutes or so out to to top off when I find an available outlet.
Also, I'll no longer be able to loudly proclaim "Can't do this with an iPhone!" when I replace the battery.