Where are you deleting it from? If you use the stock Gallery app, only the local file should be removed (if it also disappears from the Google Photos app, that probably means the picture was never backed up to begin with and it was never in the cloud). If you use the Photos app, unfortunately, that deletes the file from your phone AND from any synced location (cloud, other devices with synced copies, etc.).