Smith was born in Mechanicsville, Tennessee. He attended the local schools before enrolling in the Nashville Military Academy. He received an appointment to the United States Military Academy in West Point, New York, but resigned and returned home. He subsequently took a position working for the Nashville & Decatur Railroad. He was buried beside many of his former comrades in the Confederate Circle of Mount Olivet Cemetery in Nashville.