Fryer was born at Wells-next-the-Sea, Norfolk. After his naval service, he returned to Wells, and his grave in the churchyard is now clearly identified. In 1787, Fryer was appointed Master of the HMAV Bounty, with Fletcher Christian as Master's Mate. The Bounty's Captain William Bligh on 10 January 1788 put his crew on three watches, giving one of them to Christian; and on 2 March 1788 ordered Christian promoted to Acting Lieutenant. Some have speculated that this was the source of the ill-will that later developed between Fryer and Bligh. However, as a Master, Fryer would never have been promoted to lieutenant at sea. Indeed, he never did become a lieutenant.