Ben watched nervously as the carer led his vulnerable brother Simon out of their flat and onto the busy London street.