"It might be in my party's interest for him to sit there, it's not in the national interest and I would say, for heaven's sake man, go."