Yes, it's nearly the exact same as proper AT&T service. There are some areas where you might not get service because it's an AT&T roaming zone (prepaid carriers don't have robust roaming like postpaid does), but those are few and far between.
When you buy your Straight Talk SIM, be sure to choose that you want AT&T or T-Mobile. They offer both services.