Mind Matters Natural and Artificial Intelligence News and Analysis

TagShannon information

fragment-of-snow-texture-snowflakes-close-up-crystal-clear-ice-macro-photo-winter-shallow-depth-of-field-christmas-background-for-layout-christmas-theme-stockpack-adobe-stock
fragment of snow texture Snowflakes close-up. crystal clear ice. macro photo. winter. shallow depth of field. Christmas background for layout. christmas theme.

How Information Becomes Everything, Including Life

Without the information that holds us together, we would just be dust floating around the room

In Define information before you talk about it, neurosurgeon Michael Egnor interviewed engineering prof Robert J. Marks on the way information, not matter, shapes our world (October 28, 2021). In the first portion, Egnor and Marks discuss questions like: Why do two identical snowflakes seem more meaningful than one snowflake? https://episodes.castos.com/mindmatters/3efb31b8-8406-43fb-a8f9-66a0b635215d-Mind-Matters-Episode-158-Robert-Marks-Egnor-Guest-Host-Information-Bingecast-rev1.mp3 This portion begins at 01:02 min. A partial transcript and notes, Show Notes, and Additional Resources follow. Michael Egnor: I know that information is a topic that you have a strong professional interest and a great deal of professional expertise. Probably the best way to start is to ask what is information? Robert J. Marks: It turns out that before talking about information, you really have to define it.…

blockchain-network-data-stream-stockpack-adobe-stock
Blockchain Network, Data Stream

Define Information Before You Talk About It: Egnor Interviews Marks

Has anyone ever given you some useless information? What does it even mean for information to be meaningful? This week, on Mind Matters News, guest host Dr. Michael Egnor interviews our own Robert J. Marks about information, as well as the creative limits of artificial intelligence, and why evolutionary algorithms aren’t the magic bullet they’re often presented to be. Show…

gray-rock-formation-under-white-clouds-during-daytime-stockpack-unsplash.jpg
gray rock formation under white clouds during daytime

Robert J. Marks on Specified Complexity and Meaningful Information (Part II)

What is specified complexity? What makes some information more meaningful than other information? How does information theory affect artificial intelligence? Dr. Michael Egnor discusses information theory, artificial intelligence, and mimetic contagion with Dr. Robert J. Marks. Show Notes 00:37 | Mount Rushmore vs. Mount Fuji 05:11 | Specified complexity 10:38 | How does a statue of Abraham Lincoln differ from…

code-on-computer-monitor-stockpack-unsplash.jpg
Code on computer monitor

Robert J. Marks on Information and AI (Part I)

What is information? How is information created? Will artificial intelligence ever be creative? Dr. Michael Egnor discusses information theory, correlations, and creative artificial intelligence with Dr. Robert J. Marks. Show Notes 00:27 | Introducing Dr. Robert J. Marks 01:14 | What is information? 06:44 | Exact representations of data 08:29 | A system with minimal information 09:27 | Information in…

toothpick-stockpack-adobe-stock.jpg
toothpick

They Say This Is An Information Economy. So What Is Information?

How, exactly, is an article in the news different from a random string of letters and punctuation marks?

We know information when we see it. An article contains information. A photograph contains information. The thoughts in our mind contain information. So does a computer program and so do our genomes. Yet other things we see around us clearly do not contain information. A handful of toothpicks dropped on the ground does not. Nor do the swirling tea leaves in a cup. Neither does a pair of tossed dice nor a sequence of 100 coin flips. But mere disorder is not the clue. An intricate snowflake does not contain information either. Can we state the difference between the article and the scattered toothpicks precisely? That’s tricky. Both Claude Shannon and Andrey Kolmogorov came up with information metrics. But the…

coronavirus-disease-covid-19-infection-3d-medical-illustration-floating-china-pathogen-respiratory-influenza-covid-virus-cells-dangerous-asian-ncov-corona-virus-dna-pandemic-risk-background-design-stockpack-adobe-stock.jpeg
Coronavirus disease COVID-19 infection 3D medical illustration. Floating China pathogen respiratory influenza covid virus cells. Dangerous asian ncov corona virus, dna, pandemic risk background design

COVID-19: How 900 Bytes Changed the World

Human biology is so finely tuned that less than a kilobyte of information can stop the world. Robert J. Marks and Dr. Daniel Andrés Díaz-Pachón discuss COVID-19, DNA, and information. Show Notes 01:09 | Introducing Dr. Daniel Andrés Díaz-Pachón, Research Assistant Professor in the Division of Biostatistics at the University of Miami and Senior Researcher at the Evolutionary Informatics Lab…

toothpicks
Colorful toothpicks or pick-up sticks

How Can We Measure Meaningful Information?

Neither randomness nor order alone creates meaning. So how can we identify communications?
Dropping a handful of toothpicks on the table seems to produce a different sort of pattern than spelling out a word with toothpicks. Surprisingly, this intuitive distinction is harder to make in math and the sciences. Algorithmic specified complexity (ASC) enables us to distinguish them. Read More ›
abigail-low-462322-unsplash

Does information theory support design in nature?

William Dembski makes a convincing case, using accepted information theory principles relevant to computer science
Intelligent design theory is sometimes said to lack any practical application. One straightforward application is that, because intelligence can create information and computation cannot, human interaction will improve computational performance. Read More ›
steve-johnson-628975-unsplash

Artificial intelligence is impossible

Meaningful information vs artificial intelligence
Because the law of independence conservation states that no combination of randomness and determinism can create mutual information, then likewise no Turing machine nor artificial intelligence can create mutual information. Thus, the goal of artificial intelligence researchers to reproduce human intelligence with a computer program is impossible to achieve. Read More ›