Hi and welcome to Android Central.
What phone do you have and what carrier?
Are you saying that call waiting is not notifying you when you are on one call and get another one? Do you have call waiting enabled? If you have call waiting disabled then a second caller will automatically get voicemail. How to enable call waiting is carrier dependent, so please tell us which carrier you have.