^TagShannon information

fragment of snow texture Snowflakes close-up. crystal clear ice. macro photo. winter. shallow depth of field. Christmas background for layout. christmas theme.

^{Type
post

Author
News
Date
November 4, 2021

Categorized
Information Theory

Tagged
algorithmic specified complexity, Andrey Kolmogorov, Biology (digital information), Claude Shannon, Featured, Information (and meaning), Jacob Bernouilli, Kolmogorov information, Michael Egnor, Norbert Wiener, Physical information (concept), Robert J. Marks, Rolf Landauer, Shannon information}

How Information Becomes Everything, Including Life

_{Without the information that holds us together, we would just be dust floating around the room} _{News

November 4, 2021

12

Information Theory}

In Define information before you talk about it, neurosurgeon Michael Egnor interviewed engineering prof Robert J. Marks on the way information, not matter, shapes our world (October 28, 2021). In the first portion, Egnor and Marks discuss questions like: Why do two identical snowflakes seem more meaningful than one snowflake? https://episodes.castos.com/mindmatters/3efb31b8-8406-43fb-a8f9-66a0b635215d-Mind-Matters-Episode-158-Robert-Marks-Egnor-Guest-Host-Information-Bingecast-rev1.mp3 This portion begins at 01:02 min. A partial transcript and notes, Show Notes, and Additional Resources follow. Michael Egnor: I know that information is a topic that you have a strong professional interest and a great deal of professional expertise. Probably the best way to start is to ask what is information? Robert J. Marks: It turns out that before talking about information, you really have to define it. Read More ›

^{Type
podcast

Author
Michael Egnor
Date
October 28, 2021

Tagged
algorithm, algorithmic specified complexity, Analog computers, anthropic principle, Anthropic Principles, Artificial General Intelligence (AGI), Artificial Intelligence, causation, Claude Shannon, Correlation, Correlation vs. causation, Creativity, dead man syndrome, design in nature, evolutionary computing, informaiton, information science, Information Theory, Intelligent Design, Jacob Bernoulli, Kolmogorov information, Meaningless correlations, Norbert Wiener, physical information, Randomness, Robert J. Marks, Rolf Landauer, Shannon information, Specified Complexity, survival of the fittest}

Define Information Before You Talk About It: Egnor Interviews Marks

_{Michael Egnor

October 28, 2021

2}

Has anyone ever given you some useless information? What does it even mean for information to be meaningful? This week, on Mind Matters News, guest host Dr. Michael Egnor interviews our own Robert J. Marks about information, as well as the creative limits of artificial intelligence, and why evolutionary algorithms aren’t the magic bullet they’re often presented to be. Show Read More ›

gray rock formation under white clouds during daytime

^{Type
podcast

Author
Robert J. Marks
Date
December 10, 2020

Tagged
Artificial Intelligence, Information Theory, Jeffrey Shallit, Kolmogorov complexity, Kolmogorov information, mimetic contagion, Robert J. Marks, Shannon information, Specified Complexity}

Robert J. Marks on Specified Complexity and Meaningful Information (Part II)

_{Robert J. Marks

December 10, 2020

2}

What is specified complexity? What makes some information more meaningful than other information? How does information theory affect artificial intelligence? Dr. Michael Egnor discusses information theory, artificial intelligence, and mimetic contagion with Dr. Robert J. Marks. Show Notes Additional Resources

^{Type
podcast

Author
Robert J. Marks
Date
December 3, 2020

Tagged
algorithmic specified complexity, Analog computers, Artificial General Intelligence (AGI), Artificial Intelligence, causation, Claude Shannon, Correlation, Correlation vs causation, Creativity, design in nature, Information, information science, Information Theory, Jacob Bernoulli, Kolmogorov information, Meaningless correlations, Norbert Wiener, physical information, Robert J. Marks, Rolf Landauer, Shannon information, Specified Complexity}

Robert J. Marks on Information and AI (Part I)

_{Robert J. Marks

December 3, 2020

1}

What is information? How is information created? Will artificial intelligence ever be creative? Dr. Michael Egnor discusses information theory, correlations, and creative artificial intelligence with Dr. Robert J. Marks. Show Notes Additional Resources

^{Type
post

Author
Eric Holloway
Date
October 1, 2020

Categorized
Information Theory

Tagged
Featured, Form, Information, Information economy, Kolmogorov complexity, Patterns, Shannon information}

They Say This Is An Information Economy. So What Is Information?

_{How, exactly, is an article in the news different from a random string of letters and punctuation marks?} _{Eric Holloway

October 1, 2020

4

Information Theory}

We know information when we see it. An article contains information. A photograph contains information. The thoughts in our mind contain information. So does a computer program and so do our genomes. Yet other things we see around us clearly do not contain information. A handful of toothpicks dropped on the ground does not. Nor do the swirling tea leaves in a cup. Neither does a pair of tossed dice nor a sequence of 100 coin flips. But mere disorder is not the clue. An intricate snowflake does not contain information either. Can we state the difference between the article and the scattered toothpicks precisely? That’s tricky. Both Claude Shannon and Andrey Kolmogorov came up with information metrics. But the Read More ›

Coronavirus disease COVID-19 infection 3D medical illustration. Floating China pathogen respiratory influenza covid virus cells. Dangerous asian ncov corona virus, dna, pandemic risk background design

^{Type
podcast

Author
Robert J. Marks and Daniel Andrés Díaz-Pachón
Date
April 23, 2020

Tagged
air quality, autocorrect, binary digit, Coronavirus, COVID-19, DNA, Information, mutation, Shannon information}

COVID-19: How 900 Bytes Changed the World

_{Robert J. Marks and Daniel Andrés Díaz-Pachón

April 23, 2020

1}

Human biology is so finely tuned that less than a kilobyte of information can stop the world. Robert J. Marks and Dr. Daniel Andrés Díaz-Pachón discuss COVID-19, DNA, and information. Show Notes 01:09 | Introducing Dr. Daniel Andrés Díaz-Pachón, Research Assistant Professor in the Division of Biostatistics at the University of Miami and Senior Researcher at the Evolutionary Informatics Lab Read More ›

^{Type
post

Author
Eric Holloway
Date
December 27, 2018

Categorized
Machine Learning

Tagged
Featured, Information, Kolmogorov information, meaning, Order, Randomness, Shannon information}

How Can We Measure Meaningful Information?

_{Neither randomness nor order alone creates meaning. So how can we identify communications?} _{Eric Holloway

December 27, 2018

4

Machine Learning}

Dropping a handful of toothpicks on the table seems to produce a different sort of pattern than spelling out a word with toothpicks. Surprisingly, this intuitive distinction is harder to make in math and the sciences. Algorithmic specified complexity (ASC) enables us to distinguish them. Read More ›

^{Type
post

Author
Eric Holloway
Date
October 16, 2018

Categorized
Artificial Intelligence, Natural Intelligence

Tagged
Explanatory Filter, Information Theory, Kolmogorov information, Moravec's Paradox, Shannon information, William Dembski}

Does information theory support design in nature?

_{William Dembski makes a convincing case, using accepted information theory principles relevant to computer science} _{Eric Holloway

October 16, 2018

7

Artificial Intelligence, Natural Intelligence}

Intelligent design theory is sometimes said to lack any practical application. One straightforward application is that, because intelligence can create information and computation cannot, human interaction will improve computational performance. Read More ›

^{Type
post

Author
Eric Holloway
Date
September 19, 2018

Categorized
Artificial Intelligence

Tagged
Information Theory, Law of Independence Conservation, Leonid Levin, mutual information, Shannon information, Turing Machine}

Artificial intelligence is impossible

_{Meaningful information vs artificial intelligence} _{Eric Holloway

September 19, 2018

4

Artificial Intelligence}

Because the law of independence conservation states that no combination of randomness and determinism can create mutual information, then likewise no Turing machine nor artificial intelligence can create mutual information. Thus, the goal of artificial intelligence researchers to reproduce human intelligence with a computer program is impossible to achieve. Read More ›