Welcome to Android Central! In the Calendar app, do you see a Holidays calendar in your calendar list? If so, toggle it off.
Or are you talking about religious holidays, like Islamic ones? That's a common question -- if your phone was intended for the Levant region (i.e., Middle East), I believe many manufacturers (like Samsung) include Islamic holidays in the firmware for that region, and it's not something you can get rid of.