James Muse was born circa 1783 in either Essex County or Westmoreland County, Virginia, the son of a man by the same name who fought for the British during the Revolutionary War. In 1801 Muse’s sister Peggy and her husband summoned Muse to appear in chancery court regarding his father’s will, of which he was a witness and administrator. In 1812 Muse married Mary Ann "Polly" W. Coleman; they would have one son. Muse's will was dated 14 February 1815 and proved on 17 July 1815, indicating that he died between those two dates.