"It should not surprise Muslims if doubts were entertained about their loyalty. They could not ride on two horses."