If the Tory party won’t relinquish the millions from its disgraced donor, it will be saying it doesn’t have a problem being associated with racism