I've plugged in the USB cable into my computer and it displays the phone, but am not able to go any further on how to actually get the process going. I need step by step instructions.
It depends on the voice recording app - some of them save the recordings to files, some save them to databases. (And some save them in system areas, so the phone has to be rooted for you to get to them.)