Speaking to Fox News on Monday night the former president said that he was ‘prepared’ to face Biden in November, but that it ‘wasn’t going to matter’