Dev claim · claim-1057 · #23 of 154
““Moreover, the ocean already contains so-called oxygen minimum zones, generally found in the middle depths.”
Claim tags (sorted stems; highlighted when a passage shares them)
- alreadi
- call
- contain
- depth
- found
- gener
- middl
- minimum
- moreov
- ocean
- oxygen
- zone
The model’s verdict
The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.
Notebook protocol
Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.
- Supports
- 50.8%
- Refutes
- 18.3%
- Not enough info
- 19.0%
- Disputed
- 12.0%
One claim at a time
The same model run on a single claim, which is how the Try-it page runs it.
- Supports
- 49.5%
- Refutes
- 20.0%
- Not enough info
- 21.5%
- Disputed
- 8.9%
With gold evidence
Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.
- Supports
- 12.4%
- Refutes
- 2.7%
- Not enough info
- 79.5%
- Disputed
- 5.4%
Retrieved vs gold evidence
Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.
2024 submission
The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.
- Path
- not recorded
- Found
- 0 of 5 gold
- P
- 0.00
- R
- 0.00
- F
- 0.00
#1evidence-991680 The ashrams he founded in Agra were called Krishana Dwaras.
- محمد
- found (shared with the claim)
- call (shared with the claim)
- cos
- 0.494
- overlap
- 0.667
- score
- 1.161
- shared
- 2
#2evidence-331581 Equetus is a genus of drumfishes found in the middle western Atlantic Ocean and the Caribbean.
- middl (shared with the claim)
- atlant
- caribbean
- genu
- found (shared with the claim)
- western
- ocean (shared with the claim)
- cos
- 0.580
- overlap
- 0.429
- score
- 1.009
- shared
- 3
#3evidence-521792 Phyllorhinichthys balushkini is a species of dreamer found in the Atlantic Ocean.
- atlant
- ocean (shared with the claim)
- found (shared with the claim)
- speci
- cos
- 0.499
- overlap
- 0.500
- score
- 0.999
- shared
- 2
#4evidence-1123762 It is generally found in deposits of metamorphosed manganese.
- محمد
- deposit
- gener (shared with the claim)
- found (shared with the claim)
- cos
- 0.491
- overlap
- 0.500
- score
- 0.991
- shared
- 2
#5evidence-941376 Organotrifluoroborates are organoboron compounds that contain an anion with the general formula [RBF3] −.
- formula
- contain (shared with the claim)
- anion
- compound
- gener (shared with the claim)
- cos
- 0.560
- overlap
- 0.400
- score
- 0.960
- shared
- 2
#6evidence-27292 It contains the species Stenovalva disclusa, which is found in Israel.
- israel
- contain (shared with the claim)
- found (shared with the claim)
- speci
- cos
- 0.458
- overlap
- 0.500
- score
- 0.958
- shared
- 2
Gold evidence (5)
evidence-747577 Dead zones are hypoxic (low-oxygen) areas in the world's oceans and large lakes, caused by "excessive nutrient pollution from human activities coupled with other factors that deplete the oxygen required to support most marine life in bottom and near-bottom water.
- bottom
- dead
- deplet
- excess
- nutrient
- coupl
- factor
- oxygen (shared with the claim)
- pollut
evidence-69294 These areas are also known as oxygen minimum zones (OMZ).
- area
- محمد
- known
- minimum (shared with the claim)
- zone (shared with the claim)
- oxygen (shared with the claim)
- also
evidence-754329 The oxygen minimum layer exists somewhere between a depth of 700m and 1000m deep depending on the place in the ocean.
- exist
- oxygen (shared with the claim)
- place
- minimum (shared with the claim)
- depend
- deep
- layer
- somewh
- depth (shared with the claim)
- ocean (shared with the claim)
evidence-21184 The deeper layer becomes oxygen starved and can become saturated with carbon dioxide, or other gases such as sulfur dioxide if there is even a trace of volcanic activity.
- volcan
- trace
- satur
- gase
- sulfur
- dioxid
- becom
- layer
- deeper
- oxygen (shared with the claim)
evidence-754923 The oxygen consumption due to respiration of most of the sinking organic matter and lack of gas exchange, often creates an oxygen minimum zone (OMZ) in the mesopelagic.
- respir
- lack
- consumpt
- exchang
- minimum (shared with the claim)
- zone (shared with the claim)
- sink
- oxygen (shared with the claim)
- matter