Skip to content
Climate Claim Checker

Dev claim · claim-2093 · #99 of 154

“Through its impacts on the climate, CO2 presents a danger to public health and welfare, and thus qualifies as an air pollutant”

Claim tags (sorted stems; highlighted when a passage shares them)

  • air
  • climat
  • danger
  • health
  • impact
  • pollut
  • present
  • public
  • qualifi
  • thu
  • welfar

Annotators’ label

Supports Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Not enough info✗ differs from the label
Supports
21.2%
Refutes
5.6%
Not enough info
66.0%
Disputed
7.1%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Not enough info✗ differs from the label
Supports
34.4%
Refutes
9.9%
Not enough info
42.5%
Disputed
13.3%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Supports✓ matches the label
Supports
61.6%
Refutes
31.3%
Not enough info
0.5%
Disputed
6.6%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 1 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-180997

    impacts.

    • impact (shared with the claim)
    cos
    0.376
    overlap
    1.000
    score
    1.376
    shared
    1
  2. #2evidence-1124783

    Publications : 1970 - 1971 - 1972 - 1973 - 1974 - 1975 - 1976 - 1977 - 1978 - 1979

    • public (shared with the claim)
    cos
    0.323
    overlap
    1.000
    score
    1.323
    shared
    1
  3. #3evidence-1155059

    Wahluke School District (Public) is a public school district in rural Grant County, Washington, United States, serving the communities of Mattawa, Beverly, Schwana, and Desert Aire.

    • public (shared with the claim)
    cos
    0.323
    overlap
    1.000
    score
    1.323
    shared
    1
  4. #4evidence-1122962

    Generally, impacts on public health will be more negative than positive.

    • impact (shared with the claim)
    • health (shared with the claim)
    • public (shared with the claim)
    • posit
    • neg
    • gener
    cos
    0.492
    overlap
    0.500
    score
    0.992
    shared
    3
  5. #5evidence-1082289

    Activities warranting the award of the Public Health Service Achievement Medal could include advancement of program objectives, sustained above-average dedication to duty over a relatively short period of time, or a single act of distinction to the betterment of the United States of America in the area of public health.

    • warrant
    • health (shared with the claim)
    • public (shared with the claim)
    • duti
    cos
    0.485
    overlap
    0.500
    score
    0.985
    shared
    2
  6. #6evidence-697908

    He is an expert on psychotraumatology, epidemiology and public health.

    • public (shared with the claim)
    • health (shared with the claim)
    • epidemiolog
    • expert
    cos
    0.485
    overlap
    0.500
    score
    0.985
    shared
    2

Gold evidence (1)

  1. evidence-743065

    An air pollutant is a material in the air that can have adverse effects on humans and the ecosystem.

    • human
    • air (shared with the claim)
    • ecosystem
    • adver
    • materi
    • effect
    • pollut (shared with the claim)