Skip to content
Climate Claim Checker

Dev claim · claim-266 · #136 of 154

“The IPCC no longer includes the ‘Hockey stick’ chart in its reports.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • chart
  • hockey
  • includ
  • ipcc
  • longer
  • report
  • stick

Annotators’ label

Not enough info Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Supports✗ differs from the label
Supports
59.3%
Refutes
36.0%
Not enough info
0.2%
Disputed
4.5%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Supports✗ differs from the label
Supports
52.1%
Refutes
41.0%
Not enough info
4.0%
Disputed
2.9%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Not enough info✓ matches the label
Supports
5.3%
Refutes
1.0%
Not enough info
91.2%
Disputed
2.6%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 5 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-1035574

    These reports include:

    • report (shared with the claim)
    • محمد
    • includ (shared with the claim)
    cos
    0.630
    overlap
    0.667
    score
    1.297
    shared
    2

Gold evidence (5)

  1. evidence-380933

    Besides the Sixth Assessment Report, to be completed in 2022, the IPCC released the Special Report on Global Warming of 1.5 °C in October 2018, released an update to its 2006 Guidelines for National Greenhouse Gas Inventories—the 2019 Refinement—in May 2019, and delivered two further special reports in 2019: the Special Report on Climate Change and Land (SRCCL), published online on 7 August, and the Special Report on the Ocean and Cryosphere in a Changing Climate (SROCC), released on 25 September 2019.

    • relea
    • special
    • chang
    • report (shared with the claim)
    • climat
    • ipcc (shared with the claim)
    • guidelin
  2. evidence-281372

    A paragraph in the 2007 Working Group II report ("Impacts, Adaptation and Vulnerability"), chapter 10 included a projection that Himalayan glaciers could disappear by 2035 Glaciers in the Himalaya are receding faster than in any other part of the world (see Table 10.9) and, if the present rate continues, the likelihood of them disappearing by the year 2035 and perhaps sooner is very high if the Earth keeps warming at the current rate.

    • glacier
    • likelihood
    • disappear
    • himalayan
    • faster
    • rate
    • sooner
    • himalaya
  3. evidence-327755

    The third assessment report (TAR) prominently featured a graph labeled "Millennial Northern Hemisphere temperature reconstruction" based on a 1999 paper by Michael E. Mann, Raymond S. Bradley and Malcolm K. Hughes (MBH99), which has been referred to as the "hockey stick graph".

    • stick (shared with the claim)
    • hemisph
    • malcolm
    • graph
    • raymond
    • mann
    • tar
    • bradley
  4. evidence-794055

    Contrarian John Lawrence Daly featured a modified version of the IPCC 1990 schematic, which he mis-identified as appearing in the IPCC 1995 report, and argued that "Overturning its own previous view in the 1995 report, the IPCC presented the 'Hockey Stick' as the new orthodoxy with hardly an apology or explanation for the abrupt U-turn since its 1995 report".

    • dali
    • modifi
    • apolog
    • stick (shared with the claim)
    • report (shared with the claim)
    • abrupt
    • ipcc (shared with the claim)
    • overturn
    • explan
    • hardli
  5. evidence-1085447

    The IPCC has published five comprehensive assessment reports reviewing the latest climate science, as well as a number of special reports on particular topics.

    • latest
    • assess
    • topic
    • report (shared with the claim)
    • ipcc (shared with the claim)
    • particular
    • review
    • comprehen

Optional · uses your own API key

Second opinion from an LLM

The model reads this claim and the evidence passages shown on this page, picks one of the four verdicts and cites the passages it used. It is told to judge from the passages only. You review the answer; the call and your decision go to the AI audit log in this browser.

Evidence to send

Without a key nothing is sent anywhere. The rest of the site does not need one.