Born in the District of Columbia, Ramsay was appointed midshipman on 5 October 1850. After training in Preble and in St. Lawrence, he graduated from the U.S. Naval Academy in 1856. He subsequently served in Falmouth with the Brazil Squadron; in Merrimack with the Pacific Squadron; on ordnance duty at the Washington Navy Yard; and in Saratoga on the Africa Station.