Flashlight notifications don't work

[Edible Walrus]

I've gone to accessibility, turned the flashlight notification on and received several notifications since then. Not once has the flash gone off. I'm on 5.0.1

EDIT: It's working for the alarm. Does the phone need to be face down for it to work?