Gallery shows all pictures on the phone, it has no folder of its own so the pictures aren't getting "saved in your gallery", they're getting stored temprarily on the phone (and, for some reason, not getting deleted after they're being sent).
You can use a file manager to delete the smaller of the two files you find, or you can bring the phone into a reliable repair shop and have them diagnose and fix the underlying problem.