You should be fine, just check your other apps and make sure they don't require other apps to run, if you get what I'm saying, like some Launchers require a notification "add-on" to work properly, if you think they do not require other apps then you're good to delete. If it was me though I'd keep a backup of all those APK's just in case...
They best way to go about this would be to just reset your phone and next time make sure you will use an app before you download it, then if you do not like it delete the APK right away so you don't have to go hunting through folders looking for it.