Dev claim · claim-1097 · #82 of 154
““[…]The impact on calcification, metabolism, growth, fertility and survival of calcifying marine species when pH is lowered up to 0.3 units […] is beneficial, not damaging.”
Claim tags (sorted stems; highlighted when a passage shares them)
- benefici
- calcif
- calcifi
- damag
- fertil
- growth
- impact
- lower
- marin
- metabol
- ph
- speci
- surviv
- unit
The model’s verdict
The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.
Notebook protocol
Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.
- Supports
- 7.7%
- Refutes
- 1.7%
- Not enough info
- 86.5%
- Disputed
- 4.2%
One claim at a time
The same model run on a single claim, which is how the Try-it page runs it.
- Supports
- 22.3%
- Refutes
- 4.9%
- Not enough info
- 58.1%
- Disputed
- 14.7%
With gold evidence
Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.
- Supports
- 47.5%
- Refutes
- 13.3%
- Not enough info
- 24.1%
- Disputed
- 15.0%
Retrieved vs gold evidence
Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.
2024 submission
The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.
- Path
- not recorded
- Found
- 0 of 2 gold
- P
- 0.00
- R
- 0.00
- F
- 0.00
#1evidence-180997 impacts.
- impact (shared with the claim)
- cos
- 0.495
- overlap
- 1.000
- score
- 1.495
- shared
- 1
#2evidence-185970 ``MMMBop'' was phenomenally successful, especially for a debut single, reaching number one in 27 countries including the United States, the United Kingdom, Germany, Australia and Mexico.
- unit (shared with the claim)
- cos
- 0.385
- overlap
- 1.000
- score
- 1.385
- shared
- 1
#3evidence-1050006 Philip N. Krasne (born 6 May 1905 in Norfolk, Nebraska, United States, died 18 September 1999, age 94, Los Angeles, California, United States) was an attorney who became a motion picture and television producer.
- unit (shared with the claim)
- cos
- 0.385
- overlap
- 1.000
- score
- 1.385
- shared
- 1
#4evidence-309560 In 1964, Annunzio was elected to the United States House of Representatives from a district in Chicago as a member of the United States Democratic Party.
- unit (shared with the claim)
- cos
- 0.385
- overlap
- 1.000
- score
- 1.385
- shared
- 1
#5evidence-1207075 329th Infantry Regiment (United States), unit of the United States Army during World War II
- unit (shared with the claim)
- cos
- 0.385
- overlap
- 1.000
- score
- 1.385
- shared
- 1
#6evidence-80074 Marine One is the call sign of any United States Marine Corps aircraft carrying the President of the United States.
- unit (shared with the claim)
- marin (shared with the claim)
- cos
- 0.385
- overlap
- 1.000
- score
- 1.385
- shared
- 2
Gold evidence (2)
evidence-1112531 The effects on the calcifying organisms at the base of the food webs could potentially destroy fisheries.
- web
- destroy
- food
- could
- effect
- fisheri
- organ
- potenti
evidence-616116 The German Advisory Council on Global Change stated: In order to prevent disruption of the calcification of marine organisms and the resultant risk of fundamentally altering marine food webs, the following guard rail should be obeyed: the pH of near surface waters should not drop more than 0.2 units below the pre-industrial average value in any larger ocean region (nor in the global mean).
- fundament
- marin (shared with the claim)
- disrupt
- advisori
- global