Robert Washington's family was the senior branch of the Washington family of Hertburn. In 1399, they relocated to Wastmoreland and later to Lancashire, Warwickshire, and Northamptonshire.

Washington Old Hall, near Sunderland, is the ancestral home of the Washingtons, dating to the settlement there in the 1180's of William de Hertburn, known afterwards as William de Wessynton.