I tend to buy 2 new phones a year; this year I bought the XA the day after I bought the iPhone SE. I prefer it to the SE on a quotidian basis for my own eccentric reasoning: design and build quality are top notch; it's bezel-less edge beats the Sharp Aquos Crystal - it's the nicest phone I've ever held. Performance is mid-range, battery average. It''s my only android device after the Z3 Compact (I prefer it to that, too). I don't care about storage as I stream everything so the XA will never see a microSD card.
Straight up - the SE is more of a beater device despite costing £119 more, £359 as opposed to £240, (which I don't consider expensive for the XA) but I've always tended to put modern style and minimalism above raw performance. I will use the iPhone as a second device but not that much. At least I'll get a good price when I move it on in 6 months or so.