How do I unlock and control a Samsung Note 4 with a broken screen?

[AC Question]

So I broke my screen and it's completely unviewable and doesn't work with touch.

While trying to access my phone's memory instead of paying a hefty $200 screen replacement fee, I found that the relatively recent changes to Android and Samsung are on par with Mi6, SAS, global security-level paranoia measures that make it impossible to do anything.

First off, I can't swipe my finger to unlock on a restart of the phone, it requires a numerical input, which I can't do due to the broken screen.

2nd, I can't plug in my device to a PC to access files or to view the phone screen on PC using a 3rd party app as it requires a tap of an allow access button on USB connect

3rd, I can't remotely unlock via Samsung's management tool (even though it says it's possible, can't even locate the phone) while Android Device Manager can find the phone but...

4th, Android Device Manager does not give you the option to unlock.

So does anyone know what I can do to just retrieve my files?

Thanks in advance.

P.S.: If you happen to be a spy and want to destroy information on your Samsung phone, just crack the LCD panel and voila.