Do you have smart lock activated? I did and had both trusted devices and trusted places on. With these active so long as I was at home or had my smart watch connected, I had to swipe. If I disabled this feature, the fingerprint scanner worked every time.
Also if your phone isn't set to lock...