Skip to content
Climate Claim Checker

Dev claim · claim-1605 · #106 of 154

“Scientists retracted claim that sea levels are rising.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • claim
  • level
  • retract
  • rise
  • scientist
  • sea

Annotators’ label

Refutes Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Supports✗ differs from the label
Supports
38.8%
Refutes
10.5%
Not enough info
37.9%
Disputed
12.9%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Supports✗ differs from the label
Supports
43.1%
Refutes
13.3%
Not enough info
31.3%
Disputed
12.3%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Supports✗ differs from the label
Supports
61.7%
Refutes
22.0%
Not enough info
4.4%
Disputed
12.0%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 4 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-894712

    It rises 375 metres above the sea level.

    • sea (shared with the claim)
    • level (shared with the claim)
    • metr
    • rise (shared with the claim)
    cos
    0.858
    overlap
    0.750
    score
    1.608
    shared
    3
  2. #2evidence-531719

    It is 100 ha in extent and rises to 42 m above sea level.

    • level (shared with the claim)
    • sea (shared with the claim)
    • ha
    • extent
    • rise (shared with the claim)
    cos
    1.000
    overlap
    0.600
    score
    1.600
    shared
    3
  3. #3evidence-1063753

    It rises to a height of 330 feet (101m) above sea level.

    • level (shared with the claim)
    • sea (shared with the claim)
    • feet
    • rise (shared with the claim)
    • height
    cos
    1.000
    overlap
    0.600
    score
    1.600
    shared
    3
  4. #4evidence-844529

    Atolls may also be formed by the sinking of the seabed or rising of the sea level.

    • level (shared with the claim)
    • sea (shared with the claim)
    • sink
    • atol
    • rise (shared with the claim)
    cos
    1.000
    overlap
    0.600
    score
    1.600
    shared
    3
  5. #5evidence-732643

    For the early part of the sea level rise that is associated with deglaciation, three major periods of accelerated sea level rise, called "meltwater pulses", occurred.

    • level (shared with the claim)
    • sea (shared with the claim)
    • accel
    • rise (shared with the claim)
    • pul
    cos
    1.000
    overlap
    0.600
    score
    1.600
    shared
    3
  6. #6evidence-820522

    Although previously it was thought that the polar ice caps were not contributing heavily to sea level rise (IPCC 2007), recent studies have confirmed that both Antarctica and Greenland are contributing a year each to global sea level rise.

    • contribut
    • level (shared with the claim)
    • sea (shared with the claim)
    • ipcc
    • rise (shared with the claim)
    cos
    0.865
    overlap
    0.600
    score
    1.465
    shared
    3

Gold evidence (4)

  1. evidence-988277

    Sea level rise will continue over many centuries.

    • level (shared with the claim)
    • sea (shared with the claim)
    • continu
    • mani
    • centuri
    • rise (shared with the claim)
  2. evidence-1091550

    The effects of global warming include rising sea levels, regional changes in precipitation, more frequent extreme weather events such as heat waves, and expansion of deserts.

    • precipit
    • desert
  3. evidence-98543

    Since at least the start of the 20th century, the average global sea level has been rising.

    • averag
    • level (shared with the claim)
    • least
    • sea (shared with the claim)
    • rise (shared with the claim)
    • start
    • global
  4. evidence-1121998

    "Scientists keep upping their projections for how much the oceans will rise this century".

    • much
    • project
    • scientist (shared with the claim)
    • keep
    • centuri
    • rise (shared with the claim)
    • ocean

Optional · uses your own API key

Second opinion from an LLM

The model reads this claim and the evidence passages shown on this page, picks one of the four verdicts and cites the passages it used. It is told to judge from the passages only. You review the answer; the call and your decision go to the AI audit log in this browser.

Evidence to send

Without a key nothing is sent anywhere. The rest of the site does not need one.