Dev claim · claim-665 · #147 of 154
“many scientists were surprised when other researchers subsequently found that ringed and bearded seals (the primary prey of polar bears) north of the Bering Strait especially thrived with a longer open-water season, which is particularly conducive to fishing”
Claim tags (sorted stems; highlighted when a passage shares them)
- bear
- beard
- bere
- conduc
- especi
- fish
- found
- longer
- mani
- north
- open
- particularli
- polar
- prey
- primari
- research
- ring
- scientist
- seal
- season
- strait
- subsequ
- surpris
- thrive
- water
The model’s verdict
The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.
Notebook protocol
Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.
- Supports
- 26.4%
- Refutes
- 7.2%
- Not enough info
- 57.6%
- Disputed
- 8.8%
One claim at a time
The same model run on a single claim, which is how the Try-it page runs it.
- Supports
- 38.3%
- Refutes
- 11.5%
- Not enough info
- 37.8%
- Disputed
- 12.4%
With gold evidence
Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.
- Supports
- 5.0%
- Refutes
- 0.9%
- Not enough info
- 91.5%
- Disputed
- 2.7%
Retrieved vs gold evidence
Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.
2024 submission
The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.
- Path
- not recorded
- Found
- 0 of 5 gold
- P
- 0.00
- R
- 0.00
- F
- 0.00
#1evidence-1072890 It can withhold up to 17350000 m3 of water.
- water (shared with the claim)
- cos
- 0.295
- overlap
- 1.000
- score
- 1.295
- shared
- 1
#2evidence-757301 Polygonium amphibum (water knotweed)
- water (shared with the claim)
- cos
- 0.295
- overlap
- 1.000
- score
- 1.295
- shared
- 1
#3evidence-917162 It can withhold up to 17980000 m3 of water.
- water (shared with the claim)
- cos
- 0.295
- overlap
- 1.000
- score
- 1.295
- shared
- 1
#4evidence-173869 2006 : Blóðbönd (Thicker than Water), as Ásta
- water (shared with the claim)
- cos
- 0.295
- overlap
- 1.000
- score
- 1.295
- shared
- 1
#5evidence-205807 The 2014 Connecticut Open (formerly known as the New Haven Open at Yale) was a tennis tournament played on outdoor hard courts.
- open (shared with the claim)
- cos
- 0.286
- overlap
- 1.000
- score
- 1.286
- shared
- 1
#6evidence-985207 Bar Point is a suburb of the Central Coast region of New South Wales, Australia, located on the north bank of the Hawkesbury River 53 km north of Sydney.
- north (shared with the claim)
- cos
- 0.271
- overlap
- 1.000
- score
- 1.271
- shared
- 1
Gold evidence (5)
evidence-1105120 Natural predators of the bearded seal include polar bears, who rely on these seals as a major food source.
- reli
- seal (shared with the claim)
- major
- natur
- food
- predat
- beard (shared with the claim)
- sourc
- bear (shared with the claim)
- polar (shared with the claim)
evidence-143437 The polar bear is the most carnivorous species of bear, and its diet primarily consists of ringed (Pusa hispida) and bearded (Erignathus barbatus) seals.
- carnivor
- seal (shared with the claim)
- diet
- beard (shared with the claim)
- primarili
- consist
- ring (shared with the claim)
- bear (shared with the claim)
- polar (shared with the claim)
- speci
evidence-133419 The polar bear is the most carnivorous member of the bear family, and throughout most of its range, its diet primarily consists of ringed (Pusa hispida) and bearded seals (Erignathus barbatus).
- carnivor
- seal (shared with the claim)
- diet
- throughout
- rang
- beard (shared with the claim)
- primarili
- ring (shared with the claim)
- bear (shared with the claim)
- polar (shared with the claim)
evidence-726838 The polar bear tends to frequent areas where sea ice meets water, such as polynyas and leads (temporary stretches of open water in Arctic ice), to hunt the seals that make up most of its diet.
- temporari
- ice
- seal (shared with the claim)
- diet
- stretch
- water (shared with the claim)
- tend
- polar (shared with the claim)
evidence-578925 Ringed seals are one of the primary prey of polar bears and killer whales, and have long been a component of the diet of indigenous people of the Arctic.
- whale
- seal (shared with the claim)
- diet
- killer
- indigen
- arctic
- ring (shared with the claim)
- polar (shared with the claim)
- prey (shared with the claim)
Optional · uses your own API key
Second opinion from an LLM
The model reads this claim and the evidence passages shown on this page, picks one of the four verdicts and cites the passages it used. It is told to judge from the passages only. You review the answer; the call and your decision go to the AI audit log in this browser.
Without a key nothing is sent anywhere. The rest of the site does not need one.