Skip to content
Climate Claim Checker

Dev claim · claim-2184 · #22 of 154

“We have had ice ages and warmer periods when alligators were found in Spitzbergen.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • age
  • allig
  • found
  • ice
  • period
  • spitzbergen
  • warmer

Annotators’ label

Supports Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Supports✓ matches the label
Supports
59.7%
Refutes
34.6%
Not enough info
0.3%
Disputed
5.4%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Supports✓ matches the label
Supports
52.4%
Refutes
39.7%
Not enough info
4.7%
Disputed
3.2%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Supports✓ matches the label
Supports
58.3%
Refutes
19.7%
Not enough info
7.9%
Disputed
14.1%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 2 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-496943

    Therefore, he deduced a 41,000-year period for ice ages.

    • ice (shared with the claim)
    • period (shared with the claim)
    • therefor
    • year
    • age (shared with the claim)
    cos
    0.814
    overlap
    0.600
    score
    1.414
    shared
    3

Gold evidence (2)

  1. evidence-224942

    Earth's climate alternates between ice ages and greenhouse periods, during which there are no glaciers on the planet.

    • ice (shared with the claim)
    • period (shared with the claim)
    • earth
    • glacier
    • climat
    • altern
    • greenhou
    • planet
  2. evidence-1113919

    The current geological period, the Quaternary, which began about 2.6 million years ago and extends into the present, is marked by warm and cold episodes, cold phases called glacials (Quaternary ice age) lasting about 100,000 years, and which are then interrupted by the warmer interglacials which lasted about 10,000–15,000 years.

    • warmer (shared with the claim)
    • cold
    • interglaci
    • glacial
    • year
    • interrupt
    • last