Explore · dev set
154 claims, the evidence found for them, and the verdicts
Each row shows the annotators’ label and the retrained Transformer’s verdict. It also shows how many of the human-chosen gold passages the 2024 retrieval found. Open a claim to compare gold and retrieved evidence side by side.
Mean evidence F (2024 retrieval)
0.043
Exactly the value in the report.
Claims with any gold passage found
13 / 154
Mean precision 0.065, recall 0.042.
Verdict accuracy
38.3%
Notebook protocol. Always answering "supports" scores 44.2%.
Claims on the fallback path
47%
No passage passed the 0.55 / 0.5 thresholds in the re-run of the submission rule, so the top six by score were used instead.
154 of 154 claims
Gold label
- #752[South Australia] has the most expensive electricity in the world.Supportsmodel agrees2/2 gold · F 0.67
- #375when 3 per cent of total annual global emissions of carbon dioxide are from humans and Australia produces 1.3 per cent of this 3 per cent, then no amount of emissions reduction here will have any effect on global climate.Not enough infomodel: supports0/5 gold · F 0.00
- #1266This means that the world is now 1C warmer than it was in pre-industrial timesSupportsmodel agrees1/2 gold · F 0.67
- #871“As it happens, Zika may also be a good model of the second worrying effect — disease mutation.Not enough infomodel: supports0/5 gold · F 0.00
- #2164Greenland has only lost a tiny fraction of its ice massRefutesmodel: supports1/4 gold · F 0.40
- #1607CO2 limits won't cool the planet.Not enough infomodel agrees0/5 gold · F 0.00
- #761[Riebesell] is a world authority on the topic and has typically communicated cautiously about the effects of acidification.Not enough infomodel agrees0/5 gold · F 0.00
- #1718The actual data show high northern latitudes are warmer today than in 1940.Supportsmodel agrees0/2 gold · F 0.00
- #1273The rapid changes in the climate may have profound consequences for humans and other species… Severe drought caused food shortages for millions of people in Ethiopia, with a lack of rainfall resulting in “intense and widespread” forest fires in Indonesia that belched out a vast quantity of greenhouse gasSupportsmodel agrees0/4 gold · F 0.00
- #1786CFCs contribute to global waerming at a small level.Refutesmodel: supports0/3 gold · F 0.00
- #2796Had he used the currently accepted value of approximately 3°C warming for a doubling of atmospheric CO2, Hansen would have correctly projected the ensuing global warming.Supportsmodel: not enough info0/1 gold · F 0.00
- #2580Volcanoes emit around 0.3 billion tonnes of CO2 per year.Disputedmodel: supports1/2 gold · F 0.67
- #1219Global warming is driving major melting on the surface of Greenland’s glaciers and is speeding up their travel into the sea.”Supportsmodel agrees0/3 gold · F 0.00
- #75The science is clear, climate change is making extreme weather events, including tornadoes, worse.Supportsmodel agrees0/5 gold · F 0.00
- #2813In fact, the authors go on to estimate climate sensitivity from their findings, calculate a value between 2.3 to 4.1°C.Disputedmodel: supports0/5 gold · F 0.00
- #2335Satellite measurements of infrared spectra over the past 40 years observe less energy escaping to space at the wavelengths associated with CO2.Not enough infomodel: supports0/5 gold · F 0.00
- #161Extreme melting and changes to the climate like this has released pressure on to the continent, allowing the ground to rise up.Supportsmodel agrees0/1 gold · F 0.00
- #2243The CO2 amplifies the warming and mixes through the atmosphere, spreading warming throughout the planet.Supportsmodel: not enough info0/4 gold · F 0.00
- #1256‘Next year or the year after, the Arctic will be free of ice’Disputedmodel: supports0/5 gold · F 0.00
- #506More than 100 climate models over the past 30 years did not predict what actually happened because it was assumed carbon dioxide had the pivotal role in driving climate change and that the effects of clouds, back-radiation and the sun were trivial.Not enough infomodel: supports2/5 gold · F 0.57
- #369By 2050 there’s a scientific consensus that we reached the tipping point for ice sheets in Greenland and the West AntarcticSupportsmodel agrees0/2 gold · F 0.00
- #2184We have had ice ages and warmer periods when alligators were found in Spitzbergen.Supportsmodel agrees0/2 gold · F 0.00
- #1057“Moreover, the ocean already contains so-called oxygen minimum zones, generally found in the middle depths.Supportsmodel agrees0/5 gold · F 0.00
- #104Increases in atmospheric CO2 followed increases in temperature.Supportsmodel: not enough info0/3 gold · F 0.00
- #1975The claim that 97 percent of scientists believe humans are causing climate change has been debunked by the "head" of the United Nations Intergovernmental Panel on Climate Change.Not enough infomodel: supports0/5 gold · F 0.00
- #139And in January, one out of five British children told pollsters they were having nightmares about climate change.Supportsmodel agrees0/1 gold · F 0.00
- #2062Global warming is increasing the magnitude and frequency of droughts and floods.Supportsmodel: not enough info0/3 gold · F 0.00
- #1160With more CO2 in the atmosphere, the challenge [feeding 2.5 billion more people] can and will be met.Supportsmodel agrees0/1 gold · F 0.00
- #2679"The solubility of carbon dioxide in water is listed in the Handbook of Chemistry and Physics as a declining function of temperature. ...Not enough infomodel: supports0/5 gold · F 0.00
- #2662"...there is the contention by Wolfgang Knorr of the Department of Earth Sciences at the University of Bristol in England that carbon dioxide levels in the atmosphere are about where they were 160 years ago." (as quoted by Ken Ward Jr.)Refutesmodel: supports0/4 gold · F 0.00
- #1490the concentration of carbon dioxide in Earth’s atmosphere has climbed to a level last seen more than 3 million years ago — before humans even appeared on the rocky ball we call home.Supportsmodel agrees0/1 gold · F 0.00
- #2768The long term trend from albedo is that of cooling.Supportsmodel agrees0/3 gold · F 0.00
- #2168IPCC graph showing accelerating trends is misleadingSupportsmodel agrees0/1 gold · F 0.00
- #785In many other cases, though — hurricanes, for example — the linkage to global warming for particular trends is uncertain or disputed.Not enough infomodel: supports0/5 gold · F 0.00
- #2426"Twentieth century global warming did not start until 1910.Refutesmodel: supports0/1 gold · F 0.00
- #1292Any reasonable person can recognize both positives and negatives among the policy proposals of both Tories and Labour.Not enough infomodel: supports0/5 gold · F 0.00
- #993While there has been a mean rise of a little more than 3mm per year worldwide since the 1990s, in the last decade, the NOAA Virginia Key tide gauge just south of Miami Beach has measured a 9mm rise annually.”Supportsmodel: not enough info0/2 gold · F 0.00
- #2593[T]he study indicates “Greenland’s ice may be less susceptible to the massive meltdown predicted by computer models of climate change, the main author ... said in an interview. ...Refutesmodel: not enough info0/2 gold · F 0.00
- #1567IPCC overestimate temperature rise.Refutesmodel: supports0/1 gold · F 0.00
- #1834A 14 August 1912 article from a New Zealand newspaper contained a brief story about how burning coal might produce future warming by adding carbon dioxide to the atmosphere.Supportsmodel: not enough info0/2 gold · F 0.00
Charts for the whole set (label balance, confusion matrix, threshold trade-offs and training curves) are on the results page.