Quote of the Day
It is possible to interpret the information carried by a message as essentially the negative of its entropy, and the negative logarithm of its probability. That is, the more probable the message, the less information it gives. Clichés, for example, are less illuminating than great poems.
Alec Nevala-Lee 
As my friend Neil Rest likes to say, “Information is Surprise.” Which, like Wiener’s quote, is a way to restate Claude Shannon’s S = k log W in words.
Bill Higgins-- Beam Jockey
October 4, 2016 at 5:07 pm
@Bill Higgins: Shannon will play a significant supporting role in the John W. Campbell book: he and Campbell lived near each other, and he was one of the biggest influences on Campbell’s thinking from the early fifties onward.
nevalalee
October 4, 2016 at 9:27 pm