Skip to content
Climate Claim Checker

Dev claim · claim-1416 · #67 of 154

“In recent decades this warming has been accompanied by a constant rise in the sea level and, it would appear, by an increase of extreme weather events, even if a scientifically determinable cause cannot be assigned to each particular phenomenon.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • accompani
  • appear
  • assign
  • constant
  • decad
  • determin
  • even
  • event
  • extrem
  • increas
  • level
  • particular
  • phenomenon
  • recent
  • rise
  • scientif
  • sea
  • warm
  • weather
  • would

Annotators’ label

Supports Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Supports✓ matches the label
Supports
61.0%
Refutes
27.9%
Not enough info
2.3%
Disputed
8.8%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Supports✓ matches the label
Supports
54.5%
Refutes
29.7%
Not enough info
10.0%
Disputed
5.8%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Not enough info✗ differs from the label
Supports
23.0%
Refutes
5.2%
Not enough info
62.1%
Disputed
9.7%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 4 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-902893

    Coastal regions would be most affected by rising sea levels.

    • level (shared with the claim)
    • region
    • sea (shared with the claim)
    • would (shared with the claim)
    • rise (shared with the claim)
    • affect
    • coastal
    cos
    0.619
    overlap
    0.571
    score
    1.190
    shared
    4
  2. #2evidence-552239

    If all of this ice were melted, sea levels would rise about 60 m (200 ft).

    • melt
    • level (shared with the claim)
    • ice
    • would (shared with the claim)
    • sea (shared with the claim)
    • rise (shared with the claim)
    • ft
    cos
    0.601
    overlap
    0.571
    score
    1.172
    shared
    4

Gold evidence (4)

  1. evidence-946255

    Between 1993 and 2017, the global mean sea level rose on average by 3.1 ± 0.3 mm per year, with an acceleration detected as well.

    • averag
    • per
    • rose
    • accel
    • mm
    • detect
    • global
  2. evidence-1129603

    Further examples include sea level rise, widespread melting of snow and land ice, increased heat content of the oceans, increased humidity, and the earlier timing of spring events, such as the flowering of plants.

    • melt
    • widespread
    • increa
    • humid
    • snow
  3. evidence-456747

    Climate change is more accurate scientifically to describe the various effects of greenhouse gases on the world because it includes extreme weather, storms and changes in rainfall patterns, ocean acidification and sea level.".

    • gase
    • chang
    • rainfal
    • storm
    • accur
    • acidif
  4. evidence-1091550

    The effects of global warming include rising sea levels, regional changes in precipitation, more frequent extreme weather events such as heat waves, and expansion of deserts.

    • precipit
    • desert