Skip to content
Climate Claim Checker

Dev claim · claim-2768 · #32 of 154

“The long term trend from albedo is that of cooling.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • albedo
  • cool
  • long
  • term
  • trend

Annotators’ label

Supports Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Supports✓ matches the label
Supports
53.2%
Refutes
19.9%
Not enough info
14.9%
Disputed
12.0%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Supports✓ matches the label
Supports
50.7%
Refutes
20.4%
Not enough info
19.8%
Disputed
9.1%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Supports✓ matches the label
Supports
61.0%
Refutes
23.6%
Not enough info
3.5%
Disputed
11.9%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 3 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-817269

    They were, however, more confident over attributing changes in long-term trends of extreme weather.

    • attribut
    • trend (shared with the claim)
    • term (shared with the claim)
    • howev
    • weather
    • extrem
    • long (shared with the claim)
    • confid
    cos
    0.822
    overlap
    0.600
    score
    1.422
    shared
    3
  2. #2evidence-141026

    Climate change is a long-term, sustained trend of change in climate.

    • trend (shared with the claim)
    • term (shared with the claim)
    • chang
    • climat
    • sustain
    • long (shared with the claim)
    cos
    0.693
    overlap
    0.600
    score
    1.293
    shared
    3
  3. #3evidence-533805

    Using the long-term temperature trends for the earth scientists and statisticians conclude that it continues to warm through time.

    • warm
    • trend (shared with the claim)
    • earth
    • scientist
    • term (shared with the claim)
    • continu
    • temperatur
    • conclud
    • long (shared with the claim)
    cos
    0.601
    overlap
    0.600
    score
    1.201
    shared
    3
  4. #4evidence-166332

    The descriptive term long-period variable star refers to various groups of cool luminous pulsating variable stars.

    • variabl
    • period
    • term (shared with the claim)
    • star
    • variou
    • cool (shared with the claim)
    • descript
    • refer
    • long (shared with the claim)
    cos
    0.582
    overlap
    0.600
    score
    1.182
    shared
    3

Gold evidence (3)

  1. evidence-695602

    The scattering of radiation causes atmospheric cooling, whereas absorption can cause atmospheric warming.

    • warm
    • atmosph
    • cau
    • absorpt
    • cool (shared with the claim)
    • wherea
    • radiat
    • scatter
  2. evidence-458452

    [citation needed] Arctic regions notably release more heat back into space than what they absorb, effectively cooling the Earth.

    • heat
    • space
    • earth
    • need
    • cool (shared with the claim)
    • citat
    • effect
    • arctic
    • absorb
    • notabl
  3. evidence-1075210

    A layer of snowfall increases local albedo, reflecting away sunlight, leading to local cooling.

    • sunlight
    • away
    • snowfal
    • local
    • albedo (shared with the claim)
    • cool (shared with the claim)
    • increa
    • reflect
    • layer
    • lead