Harmar was born in Philadelphia, Pennsylvania and educated at a Quaker school. He started his military career during the American Revolutionary War, receiving a commission as a captain in 1775. He served under George Washington and Henry Lee during the war, and at its conclusion, by then a colonel, was chosen by Congress in 1784 to relay the ratified Treaty of Paris (1783) to commissioner Benjamin Franklin in Paris.