Where is Paula Deen’s restaurant? The Lady and Sons Restaurant is located in the downtown historic district at 102 W. Congress St. Directions can be accessed here. It is a short walk from several of our preferred partners.