Williams was born May 29, 1829 near Louisville, Alabama, to Judge Stith and Euphemia Williams. After attending the preparatory schools of Barbour County, he was graduated from the University of South Carolina at Columbia in 1852. He studied law in Montgomery and Tuskegee and was admitted to the bar in 1855. He commenced practice in Clayton, Alabama.