I had a bunch of screenshots on XDA with what the radios should look like before flashing the 4.0.2 radios/bootloader, after that flash, and then after the flash to the 4.0.4 radios/bootloader. I'll get them and post them later so you can see where you should be at each step. If you meet those, then you should be good. I know when flashing from 4.0.3 radios that people have experienced only one radio flashing because one of the radios (LTE, IIRC) needs to
patch from its 4.0.2 counterpart.
If it helps, my screens are on either page 8 or 9 of the "4.0.2 to 4.0.4 radios" thread on XDA, under CDMA GN Development.
Edit: Just saw your edit (lol). I'm not sure if that's the problem; if you didn't go back to 4.0.2 radios/BL, I think the problem was probably flashing atop 4.0.3 and not flashing completely. I've seen/read that if you simply flash again you should be ok--but my personal advice is to flash 4.0.2 radios/BL, reboot, go back into recovery (from either CWM or restart menu), and then flash the 4.0.2 to 4.0.4 zip from there. At least that's how I've been showing folks

.