"In cases of this sort, let us say adultery, rightness and wrongness do not depend on committing it with the right woman at the right time and in the right manner, but the mere fact of committing such action at all is to do wrong."