Factory reset with or without SD card?

I always remove it 'just in case'. Then if it's an older/full card I back its contents up to my PC, reformat the microSD card in my phone and load everything that's essential back fresh on it.
 
i've never removed an sd card from any phone or even tab that i've been factory resetting...never had a problem.