"Politicians, religionists, colonizationists, and abolitionists, have each and all, at different times, presumed to think for, dictate to, and know better what suited colored people, than they knew for themselves"