The party seems unaware of the anger from those who fear that a pioneer and others like her have been targeted, says campaigner and peer Simon Woolley