How will the ratio of China-authored to U.S.-authored highly cited (top 1%) AI papers change over the next three years? - 2021

Started Sep 08, 2021 02:40PM UTC
Closed Dec 04, 2021 04:59AM UTC

This question is a metric for an issue campaign on the future of the DoD-Silicon Valley relationship. To learn more about this issue campaign and the relevance of this question, see the campaign's subpage and a related blog post. To learn more about our new rolling risk question formats, see this blog post.

Context. Citations are a commonly used, though imperfect, measure of a paper's quality. Analyses of U.S. and China publication trends in AI have shown that while there are now more China-authored AI papers than U.S.-authored AI papers, fewer of the China-authored AI papers are highly cited. The gap is closing, however. The above-cited study from the Allen Institute estimates that China will have more top 1% (by citation count) AI papers than the U.S. in 2025. This question is based on different data than the Allen Institute study, but shows similar trends.

Data and resolution details. This question is based on (de-duplicated) publications from Dimensions, Microsoft Academic Graph, and Web of Science. We classified publications as "AI" or not using a predictive model trained on arXiv publication data, where a publication is "AI" if it’s categorized on arXiv under any of artificial intelligence, machine learning, computer vision, computation and language, multi-agent systems, or robotics. To read more about this method, see “Identifying the Development and Application of Artificial Intelligence in Scientific Text.” A paper is a "U.S. paper" if any of its authors is affiliated with a U.S.-based institution. A paper is a "China paper" if any of its authors is affiliated with a China-based institution. "Highly cited" papers are those that are in the top 1% of papers published that year by citation count. 

The historical and forecasted values are the number of highly cited China AI papers divided by the number of highly cited U.S. AI papers. 

***

The historical data underlying the graph is here.

* * *

To suggest a change or clarification to this question, please select Request Clarification from the green gear-shaped dropdown button to the right of the question.

Resolution Notes

The answer is 0.92


This question is a resolved time period from How will the ratio of China-authored to U.S.-authored highly cited (top 1%) AI papers change over the next three years?
Possible Answer Correct? Final Crowd Forecast
Less than .3 1%
More than or equal to .3 but less than .45 1%
More than or equal to .45 but less than .6 3%
More than or equal to .6 but less than .7 6%
More than or equal to .7 but less than .8 13%
More than or equal to .8 but less than .9 27%
More than or equal to .9 but less than 1 22%
More than or equal to 1 but less than 1.1 10%
More than or equal to 1.1 but less than 1.25 7%
More than or equal to 1.25 but less than 1.4 3%
More than or equal to 1.4 but less than 1.6 3%
More than or equal to 1.6 but less than 1.9 2%
More than or equal to 1.9 but less than 2.2 1%
More than or equal to 2.2 but less than 2.5 0%
More than or equal to 2.5 0%

Crowd Forecast Profile

Participation Level
Number of Forecasters 78
Average for questions older than 6 months: 60
Number of Forecasts 156
Average for questions older than 6 months: 222
Accuracy
Participants in this question vs. all forecasters average

Most Accurate

Relative Brier Score

1.
-0.072663
2.
-0.051156
4.
-0.040057
5.
-0.037581
Files
Tip: Mention someone by typing @username