Skip to content
Climate Claim Checker

Dev claim · claim-2441 · #86 of 154

“Furthermore, it is physically incorrect to state that the planet is simply "recovering" from the Little Ice Age.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • age
  • furthermor
  • ice
  • incorrect
  • littl
  • physic
  • planet
  • recov
  • simpli
  • state

Annotators’ label

Supports Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Not enough info✗ differs from the label
Supports
6.2%
Refutes
1.2%
Not enough info
89.0%
Disputed
3.6%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Not enough info✗ differs from the label
Supports
20.4%
Refutes
4.2%
Not enough info
62.0%
Disputed
13.5%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Supports✓ matches the label
Supports
62.7%
Refutes
24.6%
Not enough info
1.4%
Disputed
11.3%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 1 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-347754

    ``My Love'' is a song recorded by the American country music band Little Texas.

    • littl (shared with the claim)
    cos
    0.474
    overlap
    1.000
    score
    1.474
    shared
    1
  2. #2evidence-320757

    State Route 372 (SR 372) is a very short, two-lane east -- west state highway in the southern part of the U.S. state of Ohio.

    • state (shared with the claim)
    cos
    0.356
    overlap
    1.000
    score
    1.356
    shared
    1
  3. #3evidence-671313

    George William Whitehurst (born March 12, 1925) is a professor and retired politician who served in the United States House of Representatives from the state of Virginia.

    • state (shared with the claim)
    cos
    0.356
    overlap
    1.000
    score
    1.356
    shared
    1
  4. #4evidence-725405

    Thomas Lanier Clingman (July 27, 1812November 3, 1897), known as the ``Prince of Politicians,'' was a Democratic member of the United States House of Representatives from 1843 to 1845 and from 1847 to 1858, and U.S. senator from the state of North Carolina between 1858 and 1861.

    • state (shared with the claim)
    cos
    0.356
    overlap
    1.000
    score
    1.356
    shared
    1
  5. #5evidence-484284

    State Route 67 (SR 67) is an east -- west state highway in the U.S. state of Ohio.

    • state (shared with the claim)
    cos
    0.356
    overlap
    1.000
    score
    1.356
    shared
    1
  6. #6evidence-544750

    State Route 182 (SR 182) is a 8.7 mi state highway that runs west -- east through northern Ben Hill County in the south-central part of the U.S. state of Georgia.

    • state (shared with the claim)
    cos
    0.356
    overlap
    1.000
    score
    1.356
    shared
    1

Gold evidence (1)

  1. evidence-494148

    This trend could be extrapolated to continue into the future, possibly leading to a full ice age, but the twentieth-century instrumental temperature record shows a sudden reversal of this trend, with a rise in global temperatures attributed to greenhouse gas emissions.

    • temperatur
    • trend
    • sudden
    • twentieth