You have to root your phone to totally delete them. But, you can disable them, without having to root your phone. Go to the app manager, select the app that you want to disable, and then push disable.
Welcome to Android Central! Bear in mind that disabling bloatware can help free up system RAM, but won't free up storage ROM, so if you're looking to increase your internal storage memory, disabling unfortunately won't do a whole lot.