home *** CD-ROM | disk | FTP | other *** search
- Comments: Gated by NETNEWS@AUVM.AMERICAN.EDU
- Path: sparky!uunet!paladin.american.edu!auvm!BEN.DCIEM.DND.CA!MMT
- Message-ID: <9207241725.AA06279@chroma.dciem.dnd.ca>
- Newsgroups: bit.listserv.csg-l
- Date: Fri, 24 Jul 1992 13:25:21 EDT
- Sender: "Control Systems Group Network (CSGnet)" <CSG-L@UIUCVMD.BITNET>
- From: mmt@BEN.DCIEM.DND.CA
- Subject: Re: Energy, Entropy, Info
- X-cc: randall@dretor.dciem.dnd.ca
- Lines: 38
-
- [Martin Taylor 920724 10:30]
- (Bill Powers 920723.2130 and Allan Randall 920723.2100)
- =============
- (This mailing was sent to Bill Powers personally, by mistake. It was intended
- for CSG-L, so here it is. Sorry, Bill)
- =============
-
- I'm not going to comment directly on these two postings on information, energy,
- and entropy. And I had intended to let Bill's original report pass by, as
- well, though I sympathize with Allan's complaints about it.
-
- Information theory is much more subtle than either Bill's or Allan's
- postings would suggest. I think it would help both of them to read at least
- the first few pages of Nicolis' "Dynamics of Hierarchical Systems" (Springer
- Verlag, 1986), where he derives explicitly the relation between thermodynamic
- and informational entropy, and shows that the thermodynamic requirements on
- entropy per bit are so small that they can be ignored in any current practical
- application.
-
- Information flow can never be determined uniquely, because it is represented
- by a change in probability structure as seen by the observer identifying the
- information. That observer may be a party to the transaction, but need not
- be. Information is a perceptual construct, not a physical one. We had a
- long go-around on this last year, but if you go back to the archives and
- re-read that discussion, you might find it clarified by referring to my
- recent "mirror diagram" of PCT.
-
- Later, perhaps, if I find time, I'll try to write something that can be
- deposited in Bill Silvert's ftp system, with an abstract to the net. But
- please don't take either Bill's or Allan's assertions about what Shannon
- said too seriously. They may both be on the side of public received wisdom,
- but we all know how likely that is to be correct, don't we?
-
- I'm not trying to diminish discussion of information. Just be aware that
- the direction of both Bill's and Allan's postings is very like that of
- S-R psychology, and is just as valid.
-
- Martin
-