Charles Simms, the father of John Douglass Simms Sr., was born in Prince William County, Virginia. He studied law in Fredericksburg before serving in the Continental Army during the Revolutionary War. Simms then opened a law office in Alexandria and represented Fairfax County in the Virginia House of Delegates. In 1799 President John Adams appointed him customs collector for the Alexandria district, a post he would hold until his death.