The Florida governor said he would not have dinner with the white nationalist, but stopped short of condemning other Republicans that associated with him