Dev claim · claim-2890 · #89 of 154
“Heat is continuing to build up in the subsurface ocean.”
Claim tags (sorted stems; highlighted when a passage shares them)
- build
- continu
- heat
- ocean
- subsurfac
The model’s verdict
The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.
Notebook protocol
Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.
- Supports
- 46.0%
- Refutes
- 12.5%
- Not enough info
- 26.4%
- Disputed
- 15.1%
One claim at a time
The same model run on a single claim, which is how the Try-it page runs it.
- Supports
- 40.0%
- Refutes
- 11.5%
- Not enough info
- 35.9%
- Disputed
- 12.6%
With gold evidence
Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.
- Supports
- 36.0%
- Refutes
- 8.4%
- Not enough info
- 43.2%
- Disputed
- 12.5%
Retrieved vs gold evidence
Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.
2024 submission
The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.
- Path
- not recorded
- Found
- 1 of 5 gold
- P
- 0.17
- R
- 0.20
- F
- 0.18
#1evidence-744635 He continued:
- continu (shared with the claim)
- cos
- 0.478
- overlap
- 1.000
- score
- 1.478
- shared
- 1
#2evidence-449772 We find that climate feedbacks within the Earth system amplify the strength and duration of global warming, ocean heating and oxygen depletion.
- heat (shared with the claim)
- strength
- deplet
- amplifi
- feedback
- find
- oxygen
- durat
- ocean (shared with the claim)
- cos
- 0.756
- overlap
- 0.400
- score
- 1.156
- shared
- 2
#3evidence-742886 gold evidence The end result is a continual build-up of heat at the surface that people experience as a heat wave.
- heat (shared with the claim)
- result
- experi
- end
- peopl
- surfac
- continu (shared with the claim)
- build (shared with the claim)
- wave
- cos
- 0.521
- overlap
- 0.600
- score
- 1.121
- shared
- 3
#4evidence-255466 Because different climate models have slightly different patterns of ocean heating, they do not agree fully on the predictions for the contribution of ocean heating on sea level rise.
- heat (shared with the claim)
- agr
- fulli
- differ
- slightli
- ocean (shared with the claim)
- cos
- 0.640
- overlap
- 0.400
- score
- 1.040
- shared
- 2
#5evidence-1144500 This is due to the larger heat capacity of oceans and because oceans lose more heat by evaporation.
- heat (shared with the claim)
- larger
- capac
- due
- evapor
- lose
- ocean (shared with the claim)
- cos
- 0.634
- overlap
- 0.400
- score
- 1.034
- shared
- 2
#6evidence-995233 For example, alterations to ocean processes such as thermohaline circulation play a key role in redistributing heat in the world's oceans.
- heat (shared with the claim)
- key
- exampl
- circul
- redistribut
- ocean (shared with the claim)
- alter
- cos
- 0.630
- overlap
- 0.400
- score
- 1.030
- shared
- 2
Gold evidence (5)
evidence-742886 The end result is a continual build-up of heat at the surface that people experience as a heat wave.
- heat (shared with the claim)
- result
- experi
- end
- peopl
- surfac
- continu (shared with the claim)
- build (shared with the claim)
- wave
evidence-131135 Titan is thought to have a subsurface liquid-water ocean under the ice in addition to the hydrocarbon mix that forms atop its outer crust.
- liquid
- titan
- outer
- ice
- hydrocarbon
- mix
- atop
- crust
- thought
- ocean (shared with the claim)
evidence-71710 Underneath the thick atmospheres of the planets Uranus and Neptune, it is expected that these planets are composed of oceans of hot high-density fluid mixtures of water, ammonia and other volatiles.
- neptun
- underneath
- fluid
- volatil
- expect
- mixtur
- thick
- densiti
- planet
- ammonia
evidence-1020632 Surface heat and freshwater fluxes create global density gradients that drive the thermohaline circulation part of large-scale ocean circulation.
- heat (shared with the claim)
- scale
- flux
- drive
- circul
- densiti
- freshwat
- gradient
- ocean (shared with the claim)
evidence-674318 It plays an important role in supplying heat to the polar regions, and thus in sea ice regulation.
- heat (shared with the claim)
- ice
- suppli
- thu
- regul
- polar