Lydia Hamilton Smith was the daughter of an African mother and Irish father. In 1817, Lydia, now a widow with two sons, moved to Lancaster, PA, to work for Congressman Thaddeus Stevens. Stevens treated Lydia as an equal and despite rumors about their relationship, they had a long and cordial friendship.