yea, all the ones i've played with are a little loose, but it seems to be by design as it's easier to push the button, but not so easy as to push it by accident.
if that made any sense.
so, a little loose seems okay, but if it's almost falling off, get that replaced.