The only issue I have had with the face unlock is when I put on my "costume" for a Halloween gathering.
Day of the dead theme, I had black around my eyes. Face unlock would not work.
As I took the makeup off I tested face unlock in phases, leaving the eyes for last.
Once the eyes were cleaned, it worked again.
My unscientific guess? The flat black makeup changed the reflection pattern.