"... as soon as I got backpropagation working, I realized--because of what we'd been doing with Boltzmann machines--that you could use autoencoders to do unsupervised learning. You just get the output layer to reproduce the input layer, and then you don't need a separate teaching signal. Then the hidden units are representing some code for the input."
Quote Details
Added by wikiquote-import-bot
Unverified quote
0 likes
Academics from CanadaCognitive scientistsAcademics from the United KingdomPsychologists from CanadaComputer scientists from Canada
Original Language: English
Available Languages (1)
Sources
On autoencoders.
https://en.wikiquote.org/wiki/Geoffrey_Hinton
Revision History
No revisions have been submitted for this quote.
Categories
Geoffrey Hinton
11 quotes on TrueQuotesView all quotes by Geoffrey Hinton →
Related Quotes
"I think political systems will use it to terrorize people."
"If you or I learn something and want to transfer that knowledge to someone else, we can’t just send them a copy. But …"
"It seems very likely to a large number of people that we will get massive unemployment caused by Ai."
"I got Christianity at school and Stalinism at home. I think that was a very good preparation for being a scientist be…"
"We got quite a few applications, and one of these applications I couldn't decide if the guy was a total flake or not.…"
"Then we got very excited because now there was this very simple local-learning rule. On paper it looked just great. I…"
"I first of all explained to him why it wouldn't work, based on an argument in Rosenblatt's book, which showed that es…"
"The reason hidden units in neural nets are called hidden units is that Peter Brown told me about hidden Markov models…"
"I'm much more interested in how the brain does it. I'm only interested in applications just to prove that this is int…"
"In late 1985, I actually had a deal with Dave Rumelhart that I would write a short paper about backpropagation, which…"