It was stuck booting up with those spinning balls for awhile before it died. I was trying to kick it out of booting when it froze and wouldn't restart.
I've never tried it myself, but I don't think it would work while plugged in if the battery is completely dead. That can work for a laptop, but I suspect it wouldn't work for a device -- there has to be a functioning battery.