I've tried everything but when I try to retrain my voice it just keeps loading and Google voice is switched on. It only works if I manually press the assistant button
Welcome to Android Central! By chance, is there music or other voices in the background? Google is trained to know your voice but you never know - maybe the background noise is affecting things sometimes.