The biggest problem is that all burst mode pictures are required to be saved to the phone storage, and there isn't a lot of free room there.
You can delete all the photos by plugging your S4 via USB into your PC, navigating to DCIM on the Phone storage and deleting the image files.