Skip to content
Climate Claim Checker

Dev claim · claim-1426 · #152 of 154

“Many of the world’s coral reefs are already barren or in a state of constant decline.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • alreadi
  • barren
  • constant
  • coral
  • declin
  • mani
  • reef
  • state
  • world

Annotators’ label

Not enough info Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Not enough info✓ matches the label
Supports
5.0%
Refutes
1.2%
Not enough info
91.7%
Disputed
2.0%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Not enough info✓ matches the label
Supports
12.3%
Refutes
2.0%
Not enough info
72.3%
Disputed
13.5%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Supports✗ differs from the label
Supports
38.3%
Refutes
10.3%
Not enough info
37.4%
Disputed
14.0%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 5 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-320757

    State Route 372 (SR 372) is a very short, two-lane east -- west state highway in the southern part of the U.S. state of Ohio.

    • state (shared with the claim)
    cos
    0.528
    overlap
    1.000
    score
    1.528
    shared
    1
  2. #2evidence-671313

    George William Whitehurst (born March 12, 1925) is a professor and retired politician who served in the United States House of Representatives from the state of Virginia.

    • state (shared with the claim)
    cos
    0.528
    overlap
    1.000
    score
    1.528
    shared
    1
  3. #3evidence-725405

    Thomas Lanier Clingman (July 27, 1812November 3, 1897), known as the ``Prince of Politicians,'' was a Democratic member of the United States House of Representatives from 1843 to 1845 and from 1847 to 1858, and U.S. senator from the state of North Carolina between 1858 and 1861.

    • state (shared with the claim)
    cos
    0.528
    overlap
    1.000
    score
    1.528
    shared
    1
  4. #4evidence-484284

    State Route 67 (SR 67) is an east -- west state highway in the U.S. state of Ohio.

    • state (shared with the claim)
    cos
    0.528
    overlap
    1.000
    score
    1.528
    shared
    1
  5. #5evidence-544750

    State Route 182 (SR 182) is a 8.7 mi state highway that runs west -- east through northern Ben Hill County in the south-central part of the U.S. state of Georgia.

    • state (shared with the claim)
    cos
    0.528
    overlap
    1.000
    score
    1.528
    shared
    1
  6. #6evidence-263673

    James S. Sutterlin (March 15, 1922 -- May 8, 2017) was an American author, academic, and officer at the United States Department of State with rank equivalent to an Assistant Secretary of State, who also spent 13 years working in various capacities for the Secretariat of the United Nations.

    • state (shared with the claim)
    cos
    0.528
    overlap
    1.000
    score
    1.528
    shared
    1

Gold evidence (5)

  1. evidence-1124018

    Tropical waters contain few nutrients yet a coral reef can flourish like an "oasis in the desert".

    • tropic
    • yet
    • contain
    • desert
    • flourish
    • nutrient
    • reef (shared with the claim)
    • oasi
    • coral (shared with the claim)
  2. evidence-995813

    For example, Midway Atoll in Hawaii supports nearly three million seabirds, including two-thirds (1.5 million) of the global population of Laysan albatross, and one-third of the global population of black-footed albatross.

    • hawaii
    • third
    • midway
    • atol
    • million
    • popul
    • global
  3. evidence-1161994

    Approximately 10% of the world's coral reefs are dead.

    • dead
    • reef (shared with the claim)
    • world (shared with the claim)
    • approxim
    • coral (shared with the claim)
  4. evidence-288294

    Aquaculture is showing promise as a potentially effective tool for restoring coral reefs, which have been declining around the world.

    • declin (shared with the claim)
    • tool
    • effect
    • promi
    • reef (shared with the claim)
    • restor
    • coral (shared with the claim)
    • potenti
  5. evidence-946262

    This can rapidly result in transitions to barren landscapes where relatively few species persist.

    • barren (shared with the claim)
    • result
    • speci
    • rapidli
    • transit
    • persist
    • rel
    • landscap

Optional · uses your own API key

Second opinion from an LLM

The model reads this claim and the evidence passages shown on this page, picks one of the four verdicts and cites the passages it used. It is told to judge from the passages only. You review the answer; the call and your decision go to the AI audit log in this browser.

Evidence to send

Without a key nothing is sent anywhere. The rest of the site does not need one.