"We could extend them either by scaling up small connectionist models or by combining small-scale networks into some larger organization. In the first case, we would expect to encounter theoretical obstacles to maintaining [generalized delta rule]’s effectiveness on larger, deeper nets. And despite the reputed efficacy of other alleged remedies for the deficiencies of hill-climbing, such as “annealing,” we stay with our research conjecture that no such procedures will work very well on large-scale nets, except in the case of problems that turn out to be of low order in some appropriate sense. The second alternative is to employ a variety of smaller networks rather than try to scale up a single one... No single-method learning scheme can operate efficiently for every possible task; we cannot expect any one type of machine to account for any large portion of human psychology."
Quote Details
Added by wikiquote-import-bot
Unverified quote
0 likes
Atheists from the United StatesTuring Award laureatesJews from the United StatesPeople from New York CityComputer scientists from the United States
Original Language: English
Available Languages (1)
Sources
p. 267-268
https://en.wikiquote.org/wiki/Marvin_Minsky
Revision History
No revisions have been submitted for this quote.
Categories
Marvin Minsky
Marvin Lee Minsky (August 9, 1927 - January 24, 2016) was an American scientist in the field of artificial intelligence (AI), co-founder of MIT's AI laboratory, author of several texts on AI and philosophy, and winner of the 1969 Turing Award.
79 quotes on TrueQuotesView all quotes by Marvin Minsky →
Related Quotes
"Computer languages of the future will be more concerned with goals and less with procedures specified by the programmer."
"‘In from three to eight years we will have a machine with the general intelligence of an average human being. I mean …"
"I had the naive idea that if one could build a big enough network, with enough memory loops, it might get lucky and a…"
"Speed is what distinguishes intelligence. No bird discovers how to fly: evolution used a trillion bird-years to 'disc…"
"Will robots inherit the earth? Yes, but they will be our children."
"When David Marr at MIT moved into computer vision, he generated a lot of excitement, but he hit up against the proble…"
"An ethicist is someone who sees something wrong with whatever you have in mind."
"You don't understand anything until you learn it more than one way."
"If you like somebody's work -- just go and see them. However, don't ask for their autograph. A lot of people came and…"
"In today's computer science curricula … almost all their time is devoted to formal classification of syntactic langua…"