"The concepts of message and probability enable one, for a definite source of N messages, to define Shannon’s information. If p_i,\quad i = 1, 2, ..., N, is the relative probability of message i and \log p_i is its base-2 logarithm, then the information I of the given source is(1) \quad I = - \sum_{k=1}^N p_i \log p_i.The minus sign makes I positive because all probabilities, which are necessarily greater than or equal zero, are less than unity (their sum being\textstyle \sum_{i}^N p_i = 1, so that their logarithms are all negative."
Quote Details
Added by wikiquote-import-bot
Unverified quote
0 likes
Original Language: English
Available Languages (1)
Sources
Imported from EN Wikiquote
https://en.wikiquote.org/wiki/Julian_Barbour
Revision History
No revisions have been submitted for this quote.
Categories
Julian Barbour
40 quotes on TrueQuotesView all quotes by Julian Barbour →
Related Quotes
"In fact, I once had a discussion with a distinguished astrophysicist who said to me, well, this is what Mach said, an…"
"(quote at 14:08 of 1:54:14)"
"[[Time|[T]ime]] is really an illusion... and motion too... [T]hey are not really there in the external world. They ar…"
"If you could freeze the camera now and... show me as I am, and all the atoms... and... the whole universe... like a s…"
"If you could look microscopically... at... my molecules... you would not recognize me from one second to another. In …"
"[T]he work that I did with... has shown... time that is measured by clocks is... an average of all the changes in the…"
"[I]f you imagine two NOWs... there will be some difference between them, and if you work out some weighted average of…"
"[T]his is very different from the Newtonian picture where Newton presupposes there's a river of time flowing, that is…"
"[A NOW] has no duration. ...[I]t's absolutely instantaneous. There is no thickness to it. Nothing changes. ...So thes…"
"Thus, even now, three and a half centuries after Galileo... it is still remarkably difficult to say categorically whe…"