Rogers was educated at King's College London and Magdalen Hall, Oxford. After taking a first-class degree in 1846, he received his MA in 1849 from Magdalen and was ordained. A High Church man, he was curate of St. Paul's in Oxford, and acted voluntarily as assistant curate at Headington from 1854 to 1858, until his views changed and he turned to politics.