After a senior minister was forced to deny he is considering quitting before the general election, Labour pointed to the fact the PM has not faced the media in more than 48 hours