Welcome to Android Central! Remember that the Gallery app isn't a location where photos are stored -- it compiles a database of all of the images that are saved anywhere on your phone's storage, and displays them. It may also show photos that are saved in the cloud only (like in your Google Photos cloud library).
Check the Info on one of those duplicate photo pairs. Where are both of them stored? Is one locally saved, and the other saved to the cloud somewhere?