Ex-minister says his own party is guilty of a ‘factual inaccuracy’ days after Rishi Sunak accused of lying about Keir Starmer and Labour’s tax plans