"I know of no case where by implication of law the duty of clearing himself from an imputed fraud rests on the defendant."