Alec Nevala-Lee

Thoughts on art, creativity, and the writing life.

Quote of the Day

with 2 comments

Norbert Wiener

It is possible to interpret the information carried by a message as essentially the negative of its entropy, and the negative logarithm of its probability. That is, the more probable the message, the less information it gives. Clichés, for example, are less illuminating than great poems.

Norbert Wiener, The Human Use of Human Beings

Written by nevalalee

October 4, 2016 at 7:30 am

2 Responses

Subscribe to comments with RSS.

  1. As my friend Neil Rest likes to say, “Information is Surprise.” Which, like Wiener’s quote, is a way to restate Claude Shannon’s S = k log W in words.

    Bill Higgins-- Beam Jockey

    October 4, 2016 at 5:07 pm

  2. @Bill Higgins: Shannon will play a significant supporting role in the John W. Campbell book: he and Campbell lived near each other, and he was one of the biggest influences on Campbell’s thinking from the early fifties onward.

    nevalalee

    October 4, 2016 at 9:27 pm


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: