Mind Matters Natural and Artificial Intelligence News and Analysis

TagGoodhart’s Law

team-of-scientists-working-in-a-laboratory-carefully-conducting-experiments-and-analyzing-data-generative-ai-stockpack-adobe-stock
Team of scientists working in a laboratory, carefully conducting experiments and analyzing data. Generative AI

A Case Study in Why Peer Review May Be Unreformable

McIntosh and Hudson Vitale illustrate, by their very zeal to eliminate pro-life researchers, the built-in corruption of the peer review process
The excruciating difficulty for peer review is Goodhart’s Law: “When a measure becomes a target, it ceases to be a good measure.” Bias makes it all worse. Read More ›
robot-typing-on-keyboard-stockpack-adobe-stock.jpg
Robot typing on keyboard

Bingecast: George Montañez on Intelligence and the Turing Test

What do computer scientists say about the ability of machines to think? Alan Turing, the father of modern computer science, tackled the question in 1950 and proposed the Turing test as an answer. Is the Turing test important today? Can a deeper undertanding of intelligence be culled for the Turing test? Robert J. Marks discusses the Turing test, artificial intelligence, Read More ›

Students sitting a test in an exam hall in college

The Challenge of Teaching Machines to Generalize

Teaching students simply to pass tests provides a good illustration of the problems

We want the machine learning algorithms to learn general principles from the data, and not merely little tricks and trivia that that score high but ignore problems.

Read More ›
Robot holding blank advertising billboard 3d rendering

How You Can Really Know You’re Talking to a Computer

In a lively exchange, computer science experts offer some savvy advice

Claims that a given program has “passed the Turing test” should be treated skeptically because a program can be optimized to pass the Turing test without demonstrating any particular intelligence.

Read More ›
Chatbot / Social Bot mit Quellcode im Hintergrund
Chatbot / Social Bot mit Quellcode im Hintergrund

Can Machines Think?

What do computer scientists say about the ability of machines to think? Alan Turing, the father of modern computer science, tackled the question in 1950 and proposed the Turing test as an answer. Is the Turing test important today? Robert J. Marks discusses the Turing test with Dr. George Montañez. Show Notes 00:55 | Introducing Dr. George Montañez, Iris and Read More ›

Balancing A Male And A Female Worker In The Cloud

Why It’s So Hard To Reform Peer Review

Robert J. Marks: Reformers are battling numerical laws that govern how incentives work. Know your enemy!

Measurement creates a temptation to achieve a measurable goal by less than totally honest means. As in physics, the simple act of measuring invariably disturbs what you are trying to measure.

Read More ›