That depends on where the recording app was configured to store the recording. If the recordings were stored on a MicroSD card and your new device will accept one of those, then yes it is as simple as swapping the card from the old device to the new one. The internal memory/storage is soldered and would take considerable skill and effort to move from one device to another.
If you need additional help or have more questions or details to share, please join the site so you can reply in this thread. See
this link for instructions on how to join Android Central.