Ahh, maybe it's just normal Google then rather than On Tap, see below. The point is I don't want anything to come up when I long press the home button.
Depends on what else you have installed. Mine defaulted to Firefox search (I don't use chrome) when I would long-press the home key. That's when I decided to use Cortana... Well that and being a long time WP user. I got used to her being around...