How to ignore sim contacts for incoming calls/sms

[AC Question]

I have contacts on the sim but when I got the new phone I copied them to the phone so I can add things like photos.
But I still have the contacts on the sim as a back up.
I went to contacts and selected to only show phone contacts.
But when someone calls, it shows the contact from the sim.
How do I fix it?
p.s. I don't want to delete the contacts from the sim.