For me, market was slow at first, but it was because it was redownloading my 65 or so applications. It seemed that some of the apps, notably Google Maps, has an issue installing and the market seemed to just sit there, trying to download all the rest of my apps, seemingly forever. I manually cancelled maps and a few other ones that were just hanging. After restarting, waited 10 minutes and got a notification that 60 apps were auto restored from market and google backup. I then manually installed whatever i cancelled and haven't looked back since.
Everything is pretty snappy...
Overall, I might be switching back to my 2.1 for the time being, even tho this is pretty cool. My reasons are that wifi tethering isn't built in, and the wifi tethering app i used on 2.1 no longer works (or works by very poorly). Also, installing apps on sdcard didn't seem to be available. I used clockwork to partitin my sdcard but still do not have options to move an app to sdcard yet. I am quite pleased tho with the speed and the stability of this build, and expect nothing but good things for the final release.