Skip to content
Climate Claim Checker

Dev claim · claim-1668 · #121 of 154

“Thick arctic sea ice is in rapid retreat.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • arctic
  • ice
  • rapid
  • retreat
  • sea
  • thick

Annotators’ label

Supports Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Supports✓ matches the label
Supports
64.0%
Refutes
24.0%
Not enough info
2.1%
Disputed
9.9%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Supports✓ matches the label
Supports
52.6%
Refutes
24.8%
Not enough info
15.5%
Disputed
7.1%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Supports✓ matches the label
Supports
47.2%
Refutes
13.3%
Not enough info
27.5%
Disputed
12.0%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 3 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-471916

    If sea-ice retreats in the Arctic, the albedo of the sea will be darker which means more warming.

    • warm
    • ice (shared with the claim)
    • sea (shared with the claim)
    • albedo
    • retreat (shared with the claim)
    • mean
    • arctic (shared with the claim)
    • darker
    cos
    0.832
    overlap
    0.667
    score
    1.499
    shared
    4
  2. #2evidence-1034941

    Arctic sea ice "faces rapid melt", BBC.

    • melt
    • rapid (shared with the claim)
    • ice (shared with the claim)
    • sea (shared with the claim)
    • face
    • arctic (shared with the claim)
    • bbc
    cos
    0.804
    overlap
    0.667
    score
    1.471
    shared
    4
  3. #3evidence-254811

    Much of the Arctic Ocean is covered by sea ice that varies in extent and thickness seasonally.

    • much
    • ice (shared with the claim)
    • vari
    • sea (shared with the claim)
    • extent
    • arctic (shared with the claim)
    • thick (shared with the claim)
    • ocean
    cos
    0.702
    overlap
    0.667
    score
    1.368
    shared
    4
  4. #4evidence-1181544

    It is covered with sea ice throughout the year, the thickest sea ice in the Arctic Ocean, which can be up to 15 m thick.

    • ice (shared with the claim)
    • cover
    • sea (shared with the claim)
    • arctic (shared with the claim)
    • thick (shared with the claim)
    • throughout
    • ocean
    cos
    0.633
    overlap
    0.667
    score
    1.300
    shared
    4

Gold evidence (3)

  1. evidence-280204

    The retreat of the Arctic sea ice will accelerate global warming, as less ice cover reflects less solar radiation, and may have serious climate implications by contributing to Arctic cyclone generation.

    • ice (shared with the claim)
    • implic
    • cyclon
    • arctic (shared with the claim)
    • less
  2. evidence-1200544

    In 2002 the 12 km (7.5 mi) long floating terminus of the glacier entered a phase of rapid retreat, with the ice front breaking up and the floating terminus disintegrating and accelerating to a retreat rate of over 30 m (98 ft) per day.

    • float
    • rapid (shared with the claim)
    • accel
    • retreat (shared with the claim)
    • disintegr
    • terminu
    • phase
  3. evidence-629116

    A composite record of Arctic ice demonstrates that the floes' retreat began around 1900, experiencing more rapid melting beginning within the past 50 years.

    • begin
    • melt
    • rapid (shared with the claim)
    • demonstr
    • retreat (shared with the claim)
    • arctic (shared with the claim)
    • past
    • experienc
    • composit

Optional · uses your own API key

Second opinion from an LLM

The model reads this claim and the evidence passages shown on this page, picks one of the four verdicts and cites the passages it used. It is told to judge from the passages only. You review the answer; the call and your decision go to the AI audit log in this browser.

Evidence to send

Without a key nothing is sent anywhere. The rest of the site does not need one.