"We can't say to people 'Labour wants you to share in the running of your workplace, your community and your environment, but we don't trust you to have the final say over Brexit.'"