Just thought i'd add a few more notes from my experience in addition to Giskard's wonderful instructions - I was updating directly from Froyo, unrooted.
- at the screen with the red triangle and exclamation mark, if nothing happens after you first hit and hold the power button + vol up button...