The Tory former cabinet minister announced her intention to quit in June after she failed to receive a peerage in Boris Johnson’s resignation honours.