Whether it's slower depends on the charger. Some chargers can supply rated current from each outlet simultaneously, some can only supply rated output from one output at a time.
(It's like the old stereo specs used to be stated - something like 100 Watts per channel. But that was measuring with sound on one channel only. Try both channels running and you'd be lucky to get 45 clean Watts per channel.)
It certainly can't hurt the charger or the phone, though. The phone will draw as much as it can, up to its maximum charge rating. The charger will supply as much as is called for up to its maximum capability. You could probably charge 20 phones on a 1 Amp charger - if you were willing to wait few days.