Ok, I tried this now, but after choosing Wipe Cache Partition, the Green Android image flashed with an 'Error'-message and the phone booted and is still stuck on that Samsung logo.
Removing the SD-card was the first thing I did. I also removed the SIM-card, because I need to use it on my spare...