Skip to content
Climate Claim Checker

Dev claim · claim-2796 · #11 of 154

“Had he used the currently accepted value of approximately 3°C warming for a doubling of atmospheric CO2, Hansen would have correctly projected the ensuing global warming.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • accept
  • approxim
  • atmospher
  • correctli
  • current
  • doubl
  • ensu
  • global
  • hansen
  • project
  • use
  • valu
  • warm
  • warm
  • would

Annotators’ label

Supports Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Not enough info✗ differs from the label
Supports
27.9%
Refutes
9.9%
Not enough info
57.0%
Disputed
5.2%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Not enough info✗ differs from the label
Supports
36.0%
Refutes
8.9%
Not enough info
40.3%
Disputed
14.8%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Supports✓ matches the label
Supports
63.0%
Refutes
27.9%
Not enough info
0.6%
Disputed
8.5%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 1 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-209103

    Emmer would be elected to the United States House of Representatives four years later.

    • would (shared with the claim)
    cos
    0.343
    overlap
    1.000
    score
    1.343
    shared
    1
  2. #2evidence-842987

    It is used there for revegetation projects.

    • project (shared with the claim)
    • use (shared with the claim)
    • محمد
    cos
    0.425
    overlap
    0.667
    score
    1.092
    shared
    2
  3. #3evidence-363469

    The issues surrounding global warming commonly included are emissions and the emission of other greenhouse gases, the melting of the polar ice caps, sea-level rise, natural disasters and massive changes to lifestyles caused by global warming.

    • warm (shared with the claim)
    • global (shared with the claim)
    • emiss
    cos
    0.377
    overlap
    0.667
    score
    1.044
    shared
    2
  4. #4evidence-407459

    The Global Warming Solutions Act of 2006, or Assembly Bill (AB) 32, is a California State Law that fights global warming by establishing a comprehensive program to reduce greenhouse gas emissions from all sources throughout the state.

    • warm (shared with the claim)
    • global (shared with the claim)
    • ab
    cos
    0.377
    overlap
    0.667
    score
    1.044
    shared
    2
  5. #5evidence-453529

    The warming has not been globally uniform.

    • warm (shared with the claim)
    • global (shared with the claim)
    • uniform
    cos
    0.377
    overlap
    0.667
    score
    1.044
    shared
    2
  6. #6evidence-35625

    The global warming debate is over.

    • warm (shared with the claim)
    • debat
    • global (shared with the claim)
    cos
    0.377
    overlap
    0.667
    score
    1.044
    shared
    2

Gold evidence (1)

  1. evidence-210167

    An alternate scenario would keep the warming to below this if climate sensitivity were below 3 °C for doubled CO 2.

    • warm (shared with the claim)
    • keep
    • co
    • sensit
    • climat
    • altern
    • doubl (shared with the claim)
    • scenario