It would be a more difficult decision for me, as that's one check off of the pros and cons list, but in the end, yes. The other phone in contention at the time was the Note 2 specifically for the S-Pen. I love stylus use, but I HATE Touchwiz with a deep and abiding passion.
For me, it's cluttered (For example, I like a clean orderly Notification drawer, and on my S2 my notifications showed up more than halfway down the drawer thanks to overly large power toggles, unnecessary headers, and notifications I can't swipe away in Touchwiz but can in any other implementation of Android) and detracts from the aesthetics and design language that make 4.x versions of Android so pleasing and unique. I love the features on the One and use every one (yes, even Blinkfeed).
So the S-Pen would have put up a stronger siren song, but in the end even without the aluminum construction I believe the One?s features and overall Sense 5 would have won over the Note 2.