Joseph Winthrop Holley, born in 1874 to former slaves in Winnsboro, South Carolina, founded the institution in 1903 as the Albany Bible and Manual Training Institute. Two educators, Reverend Samuel Loomis and his wife, sent Holley to Brainerd Institute and then Revere Lay College (Massachusetts). While attending Revere Lay, Holley got to know one of the school's trustees, New England businessman, Rowland Hazard. After taking a liking to Holley, Hazard arranged for him to continue his education at Phillips Academy in Andover, Massachusetts. Holley aspired to become a minister and prepared by completing his education at Pennsylvania's Lincoln University.