Can send texts but only receive text from certain numbers. At&t nexsus5

[AC Question]

I have At&t. A Nexus 5. Recently I haven't been getting my messages from other people. They get mine but I can't receive there's. However, there are a hand full of people who's texts do come through. I have done a factory reset, etc and haven't fixed my problem. Does anyone know what might be going on?? I use hangouts for my texting and even tried messenger and still nothing.