William Byrd III was born on 6 September 1728 to William Byrd II and his second wife, Maria Taylor Byrd, at the family estate of Westover. Educated in London, he returned to Virginia and (in 1748) married Elizabeth Hill Carter (d. 1760). The two would have five children, three of whom Byrd sent to England to live with an uncle and aunt.