About all that will happen is that you're going to waste a few cents worth of electricity (because the charger is plugged into the wall). Once the battery is charged, charging stops. If the charge level drops a bit, the charger will top the battery off, then stop again. (I've left phones plugged into the charger for weeks.)
If the charger decides to go bad and blow up, your house could burn down, but that could happen if the phone is charging when you're sitting right next toit too. Any slectrical device that's plugged in can do that. The odds are better that the winning lottery ticket will just happen to blow into your pocket.
I'd sooner trust the charger not going bad, than my neighbor being honest, the risk is so small. (My laptop's been plugged in, other than when we moved 2 years ago, for about 6 years so far [I used it as a desktop with a built-in UPS] and it's still working fine.)