Skip to content
Climate Claim Checker

Dev claim · claim-1087 · #57 of 154

“The particular signature of warming in 2016 was also revealing in another way, Overpeck said, noting that the stratosphere… saw record cold temperatures last year”

Claim tags (sorted stems; highlighted when a passage shares them)

  • also
  • anoth
  • cold
  • last
  • note
  • overpeck
  • particular
  • record
  • reveal
  • said
  • saw
  • signatur
  • temperatur
  • warm
  • way
  • year

Annotators’ label

Not enough info Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Not enough info✓ matches the label
Supports
8.9%
Refutes
2.1%
Not enough info
85.4%
Disputed
3.6%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Not enough info✓ matches the label
Supports
27.5%
Refutes
6.3%
Not enough info
51.7%
Disputed
14.6%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Not enough info✓ matches the label
Supports
29.7%
Refutes
7.7%
Not enough info
51.2%
Disputed
11.4%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 5 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-926414

    They have also been recorded to be myrmecophilous.

    • also (shared with the claim)
    • record (shared with the claim)
    cos
    0.386
    overlap
    1.000
    score
    1.386
    shared
    2
  2. #2evidence-243262

    Another herbicide is Paraquat.

    • anoth (shared with the claim)
    cos
    0.349
    overlap
    1.000
    score
    1.349
    shared
    1
  3. #3evidence-18861

    Dangerous is the eighth studio album by American recording artist Michael Jackson, released on November 26, 1991 by Epic Records.

    • record (shared with the claim)
    cos
    0.295
    overlap
    1.000
    score
    1.295
    shared
    1
  4. #4evidence-1081596

    In 2011, she signed a new record deal with Epic Records, and released her self-titled fifth studio album, Ciara, in 2013 which was preceded by the U.S. R&B / Hip-Hop top-ten single ``Body Party''.

    • record (shared with the claim)
    cos
    0.295
    overlap
    1.000
    score
    1.295
    shared
    1
  5. #5evidence-834688

    City of Evil was very successful after its release, debuting at # 30 on the Billboard 200 chart and certified as a platinum record by the Recording Industry Association of America in August 2009.

    • record (shared with the claim)
    cos
    0.295
    overlap
    1.000
    score
    1.295
    shared
    1
  6. #6evidence-103203

    The Idea of Beautiful is the debut studio album by American hip hop recording artist Rapsody, released on August 28, 2012, by independent record label Jamla.

    • record (shared with the claim)
    cos
    0.295
    overlap
    1.000
    score
    1.295
    shared
    1

Gold evidence (5)

  1. evidence-382930

    The polar stratospheric clouds had a warming effect on the poles, increasing temperatures by up to 20 °C in the winter months.

    • warm (shared with the claim)
    • month
    • winter
    • stratosph
    • pole
    • temperatur (shared with the claim)
    • effect
    • cloud
    • polar
  2. evidence-818951

    that surface air temperatures would be the same as, or colder than, a given region's winter for months to years on end.

    • air
    • month
    • would
    • given
    • winter
    • surfac
    • colder
    • temperatur (shared with the claim)
  3. evidence-1020939

    The change was attributed to increasingly cold winters in the Arctic stratosphere at an altitude of approximately 20 km (12 mi), a change associated with global warming in a relationship that is still under investigation.

    • relationship
    • attribut
    • increasingli
    • altitud
    • stratosph
    • chang
    • cold (shared with the claim)
    • arctic
  4. evidence-607965

    One of the strongest predictions of the greenhouse effect is that the stratosphere will cool.

    • strongest
    • one
    • stratosph
    • cool
    • predict
    • effect
    • greenhou
  5. evidence-541555

    Global Warming theory suggests that the stratosphere should cool while the troposphere warms.

    • warm (shared with the claim)
    • troposph
    • suggest
    • stratosph
    • cool
    • theori
    • global