Skip to content
Climate Claim Checker

Dev claim · claim-578 · #80 of 154

“‘If we do nothing to reduce our greenhouse gas emissions, the kind of extreme heat we saw this past summer will be the norm when my young son is a grown man.’”

Claim tags (sorted stems; highlighted when a passage shares them)

  • emiss
  • extrem
  • ga
  • greenhous
  • grown
  • heat
  • kind
  • man
  • norm
  • noth
  • past
  • reduc
  • saw
  • son
  • summer
  • young

Annotators’ label

Supports Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Supports✓ matches the label
Supports
53.9%
Refutes
20.7%
Not enough info
14.2%
Disputed
11.2%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Supports✓ matches the label
Supports
51.1%
Refutes
20.8%
Not enough info
19.0%
Disputed
9.2%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Supports✓ matches the label
Supports
62.6%
Refutes
28.0%
Not enough info
0.9%
Disputed
8.5%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 1 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-482304

    Return of the Son of Man (16:27 -- 28)

    • son (shared with the claim)
    • return
    • man (shared with the claim)
    cos
    0.452
    overlap
    0.667
    score
    1.119
    shared
    2
  2. #2evidence-463623

    significantly reduces emissions.

    • significantli
    • reduc (shared with the claim)
    • emiss (shared with the claim)
    cos
    0.431
    overlap
    0.667
    score
    1.098
    shared
    2
  3. #3evidence-451683

    A Young Man 's Difficulties with his Bible (1877)

    • bibl
    • difficulti
    • young (shared with the claim)
    • man (shared with the claim)
    cos
    0.577
    overlap
    0.500
    score
    1.077
    shared
    2
  4. #4evidence-733732

    instand he had Cut it off, his Son Past By &

    • son (shared with the claim)
    • past (shared with the claim)
    • cut
    cos
    0.373
    overlap
    0.667
    score
    1.040
    shared
    2
  5. #5evidence-282552

    This plan aimed to reduce greenhouse gas emissions to 1990 levels by 2000.

    • aim
    • emiss (shared with the claim)
    • reduc (shared with the claim)
    • ga (shared with the claim)
    • greenhou
    cos
    0.431
    overlap
    0.600
    score
    1.031
    shared
    3
  6. #6evidence-990611

    As a young man, he enlisted in the Army during World War II and became a supply sergeant.

    • sergeant
    • suppli
    • enlist
    • young (shared with the claim)
    • man (shared with the claim)
    cos
    0.577
    overlap
    0.400
    score
    0.977
    shared
    2

Gold evidence (1)

  1. evidence-960067

    Avoiding this future warming will require a large and rapid reduction in global greenhouse gas emissions.

    • reduct
    • rapid
    • emiss (shared with the claim)
    • futur
    • ga (shared with the claim)
    • greenhou
    • avoid