The prime minister was asked ‘how anyone can trust you’ by a man who was unable to visit his mother in hospital before she passed away in 2020 while parties were happening in Downing Street