Everyday Series beta

Winograd schema challenge

Turin test's better version
Winograd schema challenge
Photo by Ferhat Deniz Fors / Unsplash


If you like our work, please consider supporting us so we can keep doing what we do. And as a current subscriber, enjoy this nice discount!

Also: if you haven’t yet, follow us on Twitter, TikTok, or YouTube!



The Winograd schema challenge is a test of reading comprehension that requires an understanding of pronouns and implicit meaning. The test consists of short paragraphs with two pronouns that can be swapped to create a new sentence with a different meaning. The challenge is to determine the correct interpretation of the pronoun. The Winograd schema challenge was developed by Hector Levesque, a professor of computer science at the University of Toronto. It is named after Terry Winograd, a pioneer in the field of artificial intelligence. The challenge is designed to test a machine's ability to understand natural language.

The Winograd schema challenge is similar to the Turing test in that it is a test of a machine's ability to understand natural language. However, the Winograd schema challenge is specifically designed to test reading comprehension, while the Turing test is designed to test a machine's ability to engage in intelligent conversation.

Weaknesses of the Turing test

The performance of Eugene Goostman exhibited some of the Turing test's problems. Several major issues are:

  • Deception: The machine is forced to construct a false identity, which is not part of intelligence.
  • Conversation: A lot of interaction may qualify as "legitimate conversation"—jokes, clever asides, points of order—without requiring intelligent reasoning.
  • Evaluation: Humans make mistakes and judges often would disagree on the results.

The Winograd schema challenge consists of a series of short paragraphs, each of which contains two pronouns that can be swapped to create a new sentence with a different meaning. The challenge is to determine the correct interpretation of the pronoun.

The Winograd schema challenge is a test of reading comprehension that requires an understanding of pronouns and implicit meaning. The test consists of short paragraphs with two pronouns that can be swapped to create a new sentence with a different meaning. The challenge is to determine the correct interpretation of the pronoun.

The Winograd schema challenge was developed by Hector Levesque, a professor of computer science at the University of Toronto. It is named after Terry Winograd, a pioneer in the field of artificial intelligence. The challenge is designed to test a machine's ability to understand natural language.

The Winograd schema challenge consists of a series of short paragraphs, each of which contains two pronouns that can be swapped to create a new sentence with a different meaning. The challenge is to determine the correct interpretation of the pronoun.

For example, consider the following paragraph:

The city councilmen refused the demonstrators a permit because they feared violence.

If the pronoun "they" is interpreted as referring to the city councilmen, then the sentence means that the city councilmen feared that the demonstrators would become violent. However, if the pronoun "they" is interpreted as referring to the demonstrators, then the sentence means that the city councilmen feared that the demonstrators would become violent.


Do you want to work with us on any of these problems?
We work on this and many such exciting problems, sometimes for fun and sometimes with commercial aspects. If you have ideas or want to explore these fields with us, please get in touch with us or reply to this email.

Productive AI is here

Enhance your productivity by adding AI to your everyday work. Hassle free.

Everyday Series

Great! You’ve successfully signed up.

Welcome back! You've successfully signed in.

You've successfully subscribed to Everyday Series.

Success! Check your email for magic link to sign-in.

Success! Your billing info has been updated.

Your billing was not updated.