What are you calling "Google"? Search? That's a widget - just replace it.
Or replace the launcher with something like Nova Launcher and really have fun. (You can't delete Google - the only thing really "Google" on the phone is your Google account, and you can always re-enter that.)