Annoyingly, I have the same problem. Sometimes the card is unmounted on boot, sometimes it it isn't, but it will unmount later.
The card worked fine in my S3 and S3 Mini, but it does this in my S4 Active and then in my S4 Mini.
This seems to indicate that it isn't the card that's at fault.
I...