Joseph Gardner Swift, the first graduate of the United States Military Academy, was born on 31 December 1783 on Nantucket Island, the son of Foster Swift and his wife, Deborah. At the age of six, he saw George Washington on Boston Common, an experience that made an indelible impression on him.