Campaigners call for the whole regulatory system to be replaced after Observer analysis finds watchdog spent more than £25m with consultancies