Skip to content
Climate Claim Checker

Dev claim · claim-2168 · #33 of 154

“IPCC graph showing accelerating trends is misleading”

Claim tags (sorted stems; highlighted when a passage shares them)

  • acceler
  • graph
  • ipcc
  • mislead
  • show
  • trend

Annotators’ label

Supports Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Supports✓ matches the label
Supports
60.8%
Refutes
26.9%
Not enough info
2.1%
Disputed
10.1%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Supports✓ matches the label
Supports
52.9%
Refutes
30.4%
Not enough info
11.2%
Disputed
5.5%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Supports✓ matches the label
Supports
61.2%
Refutes
32.7%
Not enough info
0.1%
Disputed
5.9%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 1 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-877829

    Reruns of the show were shown on MeTV until 2016.

    • show (shared with the claim)
    • shown
    cos
    1.000
    overlap
    0.500
    score
    1.500
    shared
    1
  2. #2evidence-352837

    Pathology shows multifocal granulomatous folliculitis.

    • show (shared with the claim)
    • patholog
    cos
    1.000
    overlap
    0.500
    score
    1.500
    shared
    1
  3. #3evidence-687530

    Flashbacks show how Ursula, Maleficent, and Cruella met.

    • show (shared with the claim)
    • met
    cos
    1.000
    overlap
    0.500
    score
    1.500
    shared
    1
  4. #4evidence-562190

    Katie Howard in That 80s Show (2002)

    • show (shared with the claim)
    • kati
    • howard
    cos
    1.000
    overlap
    0.333
    score
    1.333
    shared
    1
  5. #5evidence-787801

    Purina Dog Chow was the show 's sponsor.

    • show (shared with the claim)
    • dog
    • sponsor
    cos
    1.000
    overlap
    0.333
    score
    1.333
    shared
    1
  6. #6evidence-1176189

    In 1883, he showed that infantile scurvy was identical with adult scurvy.

    • adult
    • show (shared with the claim)
    • ident
    cos
    1.000
    overlap
    0.333
    score
    1.333
    shared
    1

Gold evidence (1)

  1. evidence-41418

    The IPCC needs to look at this trend in the errors and ask why it happened".

    • happen
    • ask
    • trend (shared with the claim)
    • need
    • look
    • ipcc (shared with the claim)
    • error