You can't delete it (it's part of the OS itself) but you can use alternative apps to attempt direct screen mirroring (like the Home app if you have a Chromecast or the app AllCast). Bear in mind that Smart View only works for mirroring/audio sharing, it has nothing to do with 'casting' (the Chromecast icon on supported apps).