I feel you. Coming from a 2013 MOTO X, note 4 is huge! I dropped it at least 3 times in my garage when working on the car. No case on it back then, thankfully, the screen is fine just some scuffs on the edges.
Then I decided to buy a case just in case. Got some metal bumper but they intervene...