Welcome to Android Central! Is this only on the homescreen, or also in the App Drawer? (Or does your launcher not have an App Drawer?)
If it's only on the homescreen, and if your launcher does have an App Drawer, then only the app shortcuts have been duplicated. Long-press the duplicate icon, then drag it to the Remove (not Uninstall) area.