Tory leader is 20 points behind in the polls, amids rows over a D-Day snub and a gambling scandal - but says he will be PM on Friday despite admitting Brexit is bad for many businesses