Skip to content
Climate Claim Checker

Dev claim · claim-1698 · #128 of 154

“Around 97% of climate experts agree that humans are causing global warming.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • agre
  • around
  • caus
  • climat
  • expert
  • global
  • human
  • warm

Annotators’ label

Disputed Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Supports✗ differs from the label
Supports
61.6%
Refutes
25.1%
Not enough info
3.0%
Disputed
10.4%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Supports✗ differs from the label
Supports
54.1%
Refutes
27.4%
Not enough info
12.1%
Disputed
6.4%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Supports✗ differs from the label
Supports
60.8%
Refutes
27.4%
Not enough info
2.0%
Disputed
9.9%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 2 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-617222

    Spencer has published two books on climate change: In 2008, "Climate Confusion: How Global Warming Hysteria Leads to Bad Science, Pandering Politicians and Misguided Policies that Hurt the Poor", and in 2010, "The Great Global Warming Blunder: How Mother Nature Fooled the World’s Top Climate Scientists".

    • warm (shared with the claim)
    • hurt
    • climat (shared with the claim)
    • global (shared with the claim)
    • fool
    cos
    0.648
    overlap
    0.600
    score
    1.248
    shared
    3

Gold evidence (2)

  1. evidence-503460

    Of these, 97% agree, explicitly or implicitly, that global warming is happening and is human-caused.

    • warm (shared with the claim)
    • human (shared with the claim)
    • cau
    • happen
    • agr
    • explicitli
    • global (shared with the claim)
  2. evidence-797793

    97% of the scientists surveyed agreed that global temperatures had increased during the past 100 years; 84% said they personally believed human-induced warming was occurring, and 74% agreed that "currently available scientific evidence" substantiated its occurrence.

    • agr
    • survey
    • evid
    • occurr
    • substanti
    • induc

Optional · uses your own API key

Second opinion from an LLM

The model reads this claim and the evidence passages shown on this page, picks one of the four verdicts and cites the passages it used. It is told to judge from the passages only. You review the answer; the call and your decision go to the AI audit log in this browser.

Evidence to send

Without a key nothing is sent anywhere. The rest of the site does not need one.