Depends on what phone you have and what your carrier specifies for your voicemail. For me, with my Galaxy S5, whenever I receive voicemail, I automatically receive an notification icon in the toolbar telling me that I have voicemail.
Maybe a little more detail and I can help you out!