Skip to content
Climate Claim Checker

Dev claim · claim-2399 · #91 of 154

“While the greenhouse effect is a natural occurence, too much warming has severe negative impacts on agriculture, health and environment.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • agricultur
  • effect
  • environ
  • greenhous
  • health
  • impact
  • much
  • natur
  • neg
  • occur
  • sever
  • warm

Annotators’ label

Supports Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Supports✓ matches the label
Supports
62.9%
Refutes
28.1%
Not enough info
0.6%
Disputed
8.5%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Supports✓ matches the label
Supports
54.4%
Refutes
33.1%
Not enough info
7.9%
Disputed
4.6%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Not enough info✗ differs from the label
Supports
25.9%
Refutes
5.7%
Not enough info
57.9%
Disputed
10.5%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 5 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-1205883

    There is also a Coal Impact Guide, that details coal’s effects on the environment, and by extension global warming, as well as people’s health.

    • warm (shared with the claim)
    • guid
    • impact (shared with the claim)
    • detail
    • health (shared with the claim)
    • environ (shared with the claim)
    • effect (shared with the claim)
    • coal
    • exten
    cos
    0.605
    overlap
    0.556
    score
    1.161
    shared
    5

Gold evidence (5)

  1. evidence-1047395

    The effects of global warming or climate damage include far-reaching and long-lasting changes to the natural environment, to ecosystems and human societies caused directly or indirectly by human emissions of greenhouse gases.

    • gase
    • indirectli
    • human
  2. evidence-398589

    The impact on the environment, ecosystems, the animal kingdom, society and humanity depends on how much more the Earth warms.

    • much (shared with the claim)
    • warm (shared with the claim)
    • impact (shared with the claim)
    • earth
    • ecosystem
    • anim
    • depend
    • environ (shared with the claim)
    • societi
    • kingdom
  3. evidence-1122962

    Generally, impacts on public health will be more negative than positive.

    • impact (shared with the claim)
    • health (shared with the claim)
    • public
    • posit
    • neg (shared with the claim)
    • gener
  4. evidence-504446

    Impacts include the direct effects of extreme weather, leading to injury and loss of life; and indirect effects, such as undernutrition brought on by crop failures.

    • injuri
    • indirect
    • weather
    • brought
    • effect (shared with the claim)
    • loss
    • failur
    • crop
    • extrem
  5. evidence-298450

    Future warming is projected to have a range of impacts, including sea level rise, increased frequencies and severities of some extreme weather events, loss of biodiversity, and regional changes in agricultural productivity.

    • frequenc
    • weather
    • biodiv