Well, that all depends on what part of Atl you are in... Underground Atl (near The World of Coke and Georgia State) has a bunch of good places to eat. Aside from that, you got a ton of choices off of each exit...
Yeah, I found that staying near the Olympic park (I.e. atl underground) you'll find many good places. I remember there being a good little dinner just as you come up from the subway train from the airport