Losing wifi connection

I have issues with WiFi on bone stock WRT54G and on other access points. It will be connected then after a while it stops working.
 
I wonder if this a wrt54g router issue. I have a WRT54GS v4. My WiFi is great when I am in the same room as the router. But if I go one room over, my connection drops a lot. I've had issues with stock firmware and tomato. I set my WiFi to max performance on my phone and hoping that will fix it.