Can't answer phone when I am not on the home page

[AC Question]

The little box comes up with the option to either answer or dismiss, but nothing happens when I swipe it. Samsung Galaxy s5

 

[B. Diddy]

Welcome to Android Central! Are you talking about the banner notification that appears at the top of the screen when you get a call? If so, I believe you just need to tap the Answer button, not swipe it.