I went to a conference of rightwing pollsters and party grandees. It seems their only way forward is to look back, says Guardian columnist Polly Toynbee