Earl of Malmesbury, James Harris