home *** CD-ROM | disk | FTP | other *** search
- Path: sparky!uunet!gatech!ncar!noao!amethyst!organpipe.uug.arizona.edu!organpipe.uug.arizona.edu!bill
- From: bill@nsma.arizona.edu (Bill Skaggs)
- Newsgroups: comp.ai.neural-nets
- Subject: Re: Neural Nets and Brains
- Message-ID: <BILL.92Jul23224539@ca3.nsma.arizona.edu>
- Date: 24 Jul 92 05:45:39 GMT
- References: <1992Jul21.162033.57397@cc.usu.edu> <1992Jul23.013755.18847@hubcap.clemson.edu>
- <arms.711907358@spedden> <BILL.92Jul23135614@ca3.nsma.arizona.edu>
- <arms.711935064@spedden>
- Sender: news@organpipe.uug.arizona.edu
- Organization: ARL Division of Neural Systems, Memory and Aging, University of
- Arizona
- Lines: 27
- In-Reply-To: arms@cs.UAlberta.CA's message of 23 Jul 92 23: 44:24 GMT
-
- arms@cs.UAlberta.CA (Bill Armstrong) writes:
-
- >The theory of multilayer perceptrons as used in BP is horrifying.
- >You need Kolmogorov's theorem just to show you can do everything
- >you want to approximate continuous functions, but nobody can apply
- >it in practice. In contrast, every logic designer who has heard
- >of CNF and DNF finds it *obvious* that a adaptive logic net can
- >synthesize any boolean function. So BP nets lose in a BIG way on
- >the theory side, sorry.
-
- Well, McCulloch and Pitts proved a long time ago that their networks
- could emulate any Turing machine; it's hard to get any any stronger
- than that.
-
- You provoked this argument with a claim that ALNs are the only
- reasonable approach to understanding the brain. I don't dispute that
- ALNs are very powerful and very interesting, but that claim is hubris
- of the worst kind. The argument from theoretical superiority is
- simply irrelevant. Mother Nature is an engineer, not a theoretician,
- and the brain is a collection of kludges -- some of them more elegant
- than we have any right to expect -- put together by trial and error.
- I'm not a big fan of backprop, but it does have the advantage of
- simplicity to counterbalance the disadvantage of inefficiency, and
- there is no way of knowing *a priori* which of these Mother Nature has
- considered more important.
-
- -- Bill
-