Skip to content
Climate Claim Checker

Dev claim · claim-443 · #96 of 154

““Today climate scientists are obsessed with the level of carbon dioxide in the atmosphere, a very very small part of the overall picture.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • atmospher
  • carbon
  • climat
  • dioxid
  • level
  • obsess
  • overal
  • part
  • pictur
  • scientist
  • small
  • today

Annotators’ label

Refutes Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Supports✗ differs from the label
Supports
62.8%
Refutes
26.5%
Not enough info
0.8%
Disputed
9.9%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Supports✗ differs from the label
Supports
54.0%
Refutes
31.5%
Not enough info
9.1%
Disputed
5.4%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Supports✗ differs from the label
Supports
62.7%
Refutes
29.1%
Not enough info
0.4%
Disputed
7.8%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 1 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-44588

    For contrast, today the carbon dioxide levels are at 400 ppm or 0.04%.

    • level (shared with the claim)
    • today (shared with the claim)
    • contrast
    • dioxid (shared with the claim)
    • carbon (shared with the claim)
    • ppm
    cos
    0.741
    overlap
    0.667
    score
    1.407
    shared
    4
  2. #2evidence-247672

    At times during the paleoclimate, carbon dioxide levels were two or three times greater than today.

    • level (shared with the claim)
    • today (shared with the claim)
    • dioxid (shared with the claim)
    • time
    • carbon (shared with the claim)
    • greater
    • three
    cos
    0.612
    overlap
    0.571
    score
    1.183
    shared
    4

Gold evidence (1)

  1. evidence-555729

    The world's most important greenhouse gas is carbon dioxide, a by-product of the burning of fossil fuels.

    • fuel
    • dioxid (shared with the claim)
    • fossil
    • greenhou
    • burn