Skip to content
Climate Claim Checker

Dev claim · claim-2574 · #77 of 154

“On a world scale coral reefs are in decline.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • coral
  • declin
  • reef
  • scale
  • world

Annotators’ label

Supports Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Not enough info✗ differs from the label
Supports
29.3%
Refutes
9.5%
Not enough info
52.8%
Disputed
8.3%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Supports✓ matches the label
Supports
43.1%
Refutes
16.0%
Not enough info
29.3%
Disputed
11.6%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Not enough info✗ differs from the label
Supports
24.9%
Refutes
6.2%
Not enough info
57.6%
Disputed
11.4%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 5 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-581359

    A 2003 study concluded that the world could generate 2,357,840 TWh each year from very large scale solar power plants using 1% of each of the world's deserts.

    • scale (shared with the claim)
    • twh
    • desert
    • world (shared with the claim)
    • conclud
    • solar
    cos
    1.000
    overlap
    0.400
    score
    1.400
    shared
    2
  2. #2evidence-504055

    Paratachardina pseudolobata - lobate lac scale

    • lac
    • scale (shared with the claim)
    cos
    0.783
    overlap
    0.500
    score
    1.283
    shared
    1
  3. #3evidence-365189

    In 2008, a large-scale study of fisheries that used ITQs compared to ones that didn't provided strong evidence that ITQs can help to prevent collapses and restore fisheries that appear to be in decline.

    • compar
    • scale (shared with the claim)
    • collap
    • strong
    • declin (shared with the claim)
    • evid
    • fisheri
    • restor
    • prevent
    cos
    0.783
    overlap
    0.400
    score
    1.183
    shared
    2
  4. #4evidence-964620

    Ramsfjell is a three-time world champion, and has also received silver and bronze medals at the world championships.

    • world (shared with the claim)
    • bronz
    cos
    0.622
    overlap
    0.500
    score
    1.122
    shared
    1
  5. #5evidence-1207155

    A Triumvirate in World Aviation in 1973.

    • world (shared with the claim)
    • aviat
    cos
    0.622
    overlap
    0.500
    score
    1.122
    shared
    1
  6. #6evidence-883422

    The equivalent of GPRS in the GSM world.

    • world (shared with the claim)
    • equiv
    cos
    0.622
    overlap
    0.500
    score
    1.122
    shared
    1

Gold evidence (5)

  1. evidence-369389

    Global assessments of coral reefs of the world continue to report drastic and rapid rates of decline.

    • assess
    • rapid
    • drastic
    • declin (shared with the claim)
    • rate
    • report
    • reef (shared with the claim)
    • global
    • coral (shared with the claim)
  2. evidence-406279

    "From despair to repair: Dramatic decline of Caribbean corals can be reversed".

    • dramat
    • repair
    • rever
    • declin (shared with the claim)
    • caribbean
    • coral (shared with the claim)
  3. evidence-292123

    According to the Caribbean Coral Reefs - Status Report 19702-2012, states that; stop overfishing especially fishes key to coral reef like parrotfish, coastal zone management that reduce human pressure on reef, (for example restricting coastal settlement, development and tourism) and control pollution specially sewage, may reduce coral decline or even reverse it.

    • sewag
    • tourism
    • caribbean
    • reduc
    • reef (shared with the claim)
    • coastal
    • coral (shared with the claim)
    • overfish
  4. evidence-886566

    In 1998, 16% of the world's reefs died as a result of increased water temperature.

    • result
    • water
    • increa
    • temperatur
    • die
    • reef (shared with the claim)
    • world (shared with the claim)
  5. evidence-580567

    Coral reef systems have been in decline worldwide.

    • system
    • declin (shared with the claim)
    • worldwid
    • reef (shared with the claim)
    • coral (shared with the claim)