Will AI pass the Winograd schema challenge by the end of 2024?
27
1kṀ1917Jan 1
64%
chance
1D
1W
1M
ALL
https://en.wikipedia.org/wiki/Winograd_schema_challenge
Resolves positivly if a computer program exists that can solve Winograd schemas as well as an educated, fluent-in-English human can.
Press releases making such a claim do not count; the system must be subjected to adversarial testing and succeed.
(Failures on sentences that a human would also consider ambiguous will not prevent this market from resolving positivly.)
/IsaacKing/will-ai-pass-the-winograd-schema-ch
/IsaacKing/will-ai-pass-the-winograd-schema-ch-1d7f8b4ad30e
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
1,000Sort by:
@IsaacKing how would you figure out whether this market resolves YES? if you want to give some ai like claude newsonnet a few winograd schemas, it's clear it can solve them correctly
Related questions
Related questions
Top score on codeforces by an AI model at the end of 2025
Will AI image generating models score >= 90% on Winoground by June 1, 2025?
83% chance
Will AI pass the Winograd schema challenge by the end of 2025?
86% chance
Will AI pass the Winograd schema challenge by the end of 2030?
94% chance
AI solves Millenium Prize Problem in 2025?
4% chance
Will an AI system beat humans in the GAIA benchmark before the end of 2025?
60% chance
Will an AI win Advent of Code? (2025)
34% chance
Will open-source AI win (through 2025)?
25% chance
Will an AI model achieve superhuman ELO on Codeforces by the 31 December 2025?
61% chance
Will AI pass the Longbets version of the Turing test by the end of 2029?
63% chance