I've had a Note 4 from launch day. Unfortunately I scratched the metal, hit it on the door, before my case arrived.
But there's an easy way to fix it! Have no fear!
Where ever the scratch is, as long as it's not too bad, take a soft piece of tissue. Not paper towel! Don't use paper towels...