I had always used a case and screen protector on every phone for about the last 18+ years.
The Note 4 is the first phone I am going naked with, it is just too large of a phone and too good looking of a phone to muck it up with a case.
At least a case that would do anything to help in a drop...