Will general purpose AI models beat average score of human players in Diplomacy by 2028?
10
1kṀ11712027
60%
chance
1D
1W
1M
ALL
General purpose (not trained for a specific task) language models demonstrated chess playing ability. They are also capable of deception and lie detection. Will language models or visual-language models* beat the average score of human players during a series of 40 games on webDiplomacy.net by 2028? (question modeled after Meta's Cicero result).
[EDIT: Please notice that while "CICERO achieved more than 2x the average score of its opponents" this question requires only achieving the above-average score]
*models or agents trained on different modalities (so e. g. models capable of controlling robotic arm like PaLM-E) would also qualify as long as they weren't trained specifically to play Diplomacy
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
Related questions
Related questions
In 2028, will an AI be able to play randomly selected computer games at human level without getting to practice?
58% chance
Will AI beat top Magic the Gathering human player before the end of 2028?
39% chance
Will an AI be capable of achieving a perfect score on the Putnam exam before 2026?
35% chance
Will an AI be capable of achieving a perfect score on the Putnam exam before 2030?
66% chance
Will a large language model beat a super grandmaster playing chess by 2028?
66% chance
Will AI beat top human players at Civ6 (without cheating) by EOY 2026?
26% chance
Will any AI get a score of at least 45% on Humanity’s Last Exam benchmark before March 11, 2025?
7% chance
Will an AI by OpenAI beat a super grandmaster playing chess by 2028?
74% chance
Will AI image generating models score >= 90% on Winoground by June 1, 2025?
82% chance
Will an AI score 1st place on International Math Olympiad (IMO) 2025?
28% chance