Skip to content
Climate Claim Checker

Dev claim · claim-1975 · #25 of 154

“The claim that 97 percent of scientists believe humans are causing climate change has been debunked by the "head" of the United Nations Intergovernmental Panel on Climate Change.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • believ
  • caus
  • chang
  • chang
  • claim
  • climat
  • climat
  • debunk
  • head
  • human
  • intergovernment
  • nation
  • panel
  • percent
  • scientist
  • unit

Annotators’ label

Not enough info Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Supports✗ differs from the label
Supports
54.1%
Refutes
20.6%
Not enough info
13.8%
Disputed
11.5%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Supports✗ differs from the label
Supports
50.2%
Refutes
21.8%
Not enough info
20.0%
Disputed
8.0%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Not enough info✓ matches the label
Supports
13.7%
Refutes
2.9%
Not enough info
77.9%
Disputed
5.4%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 5 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-600570

    the 2010 United Nations Climate Change Conference

    • unit (shared with the claim)
    • chang (shared with the claim)
    • climat (shared with the claim)
    • nation (shared with the claim)
    • confer
    cos
    0.693
    overlap
    0.800
    score
    1.493
    shared
    4
  2. #2evidence-851854

    See United Nations Climate Change Conference.

    • chang (shared with the claim)
    • unit (shared with the claim)
    • climat (shared with the claim)
    • see
    • nation (shared with the claim)
    • confer
    cos
    0.626
    overlap
    0.667
    score
    1.293
    shared
    4
  3. #3evidence-769529

    Hendricks led the German delegations to the 2014 United Nations Climate Change Conference in Lima and the 2015 United Nations Climate Change Conference in Paris.

    • chang (shared with the claim)
    • unit (shared with the claim)
    • hendrick
    • climat (shared with the claim)
    • nation (shared with the claim)
    • lima
    • confer
    cos
    0.693
    overlap
    0.571
    score
    1.264
    shared
    4
  4. #4evidence-636833

    The Standard was launched at 2015 United Nations Climate Change Conference (COP21).

    • unit (shared with the claim)
    • launch
    • chang (shared with the claim)
    • climat (shared with the claim)
    • nation (shared with the claim)
    • standard
    • confer
    cos
    0.571
    overlap
    0.571
    score
    1.142
    shared
    4

Gold evidence (5)

  1. evidence-963115

    The study found that 97% of the 489 scientists surveyed agreed that global temperatures have risen over the past century.

    • agr
    • scientist (shared with the claim)
    • survey
    • studi
    • temperatur
    • risen
    • past
    • global
  2. evidence-154218

    The Intergovernmental Panel on Climate Change (IPCC) is an intergovernmental body of the United Nations that is dedicated to providing the world with objective, scientific information relevant to understanding the scientific basis of the risk of human-induced climate change, its natural, political, and economic impacts and risks, and possible response options.

    • chang (shared with the claim)
    • intergovern
    • risk
    • climat (shared with the claim)
    • scientif
  3. evidence-503460

    Of these, 97% agree, explicitly or implicitly, that global warming is happening and is human-caused.

    • warm
    • human (shared with the claim)
    • cau
    • happen
    • agr
    • explicitli
    • global
  4. evidence-797793

    97% of the scientists surveyed agreed that global temperatures had increased during the past 100 years; 84% said they personally believed human-induced warming was occurring, and 74% agreed that "currently available scientific evidence" substantiated its occurrence.

    • agr
    • survey
    • evid
    • occurr
    • substanti
    • induc
  5. evidence-335835

    (i) 97–98% of the climate researchers most actively publishing in the field support the tenets of ACC (Anthropogenic Climate Change) outlined by the Intergovernmental Panel on Climate Change, and (ii) the relative climate expertise and scientific prominence of the researchers unconvinced of ACC are substantially below that of the convinced researchers.

    • acc
    • research
    • chang (shared with the claim)
    • intergovern
    • climat (shared with the claim)