There was a clear lack of diversity in the prime minister’s top team when it came to informing policy and decision-making, a hearing was told.