Skip to content
Climate Claim Checker

Dev claim · claim-1292 · #36 of 154

“Any reasonable person can recognize both positives and negatives among the policy proposals of both Tories and Labour.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • among
  • labour
  • neg
  • person
  • polici
  • posit
  • propos
  • reason
  • recogn
  • tori

Annotators’ label

Not enough info Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Supports✗ differs from the label
Supports
50.6%
Refutes
18.2%
Not enough info
18.7%
Disputed
12.4%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Supports✗ differs from the label
Supports
49.2%
Refutes
19.7%
Not enough info
22.4%
Disputed
8.8%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Not enough info✓ matches the label
Supports
2.5%
Refutes
0.5%
Not enough info
95.4%
Disputed
1.6%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 5 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-896495

    He is the only person to have held both positions.

    • held
    • posit (shared with the claim)
    • محمد
    • person (shared with the claim)
    cos
    0.490
    overlap
    0.500
    score
    0.990
    shared
    2
  2. #2evidence-1169352

    For these reasons, negative externalities are more problematic than positive externalities.

    • محمد
    • posit (shared with the claim)
    • neg (shared with the claim)
    • reason (shared with the claim)
    • extern
    cos
    0.390
    overlap
    0.600
    score
    0.990
    shared
    3
  3. #3evidence-920343

    Inter rusticos is Latin for ``among rustics'' or ``illiterate persons''.

    • among (shared with the claim)
    • person (shared with the claim)
    • inter
    • latin
    cos
    0.484
    overlap
    0.500
    score
    0.984
    shared
    2
  4. #4evidence-237746

    Mashti Goundala occupy the lowest position among the Goundala sub-castes.

    • among (shared with the claim)
    • lowest
    • cast
    • occupi
    • posit (shared with the claim)
    • sub
    cos
    0.609
    overlap
    0.333
    score
    0.942
    shared
    2
  5. #5evidence-566181

    , iLoveMakonnen and Offset, among others.

    • among (shared with the claim)
    • offset
    cos
    0.434
    overlap
    0.500
    score
    0.934
    shared
    1
  6. #6evidence-480899

    Population density is of 15 persons per square kilometer of land area, well below the world average of 50 persons.

    • person (shared with the claim)
    • kilomet
    cos
    0.431
    overlap
    0.500
    score
    0.931
    shared
    1

Gold evidence (5)

  1. evidence-342343

    Less attention was given to policy areas that might have been problematic for the Conservatives, like the NHS or housing (policy topics favoured by Labour) or immigration (favoured by UKIP).

    • conserv
    • topic
    • favour
    • might
    • nh
    • polici (shared with the claim)
    • immigr
    • attent
    • labour (shared with the claim)
    • less
  2. evidence-399707

    In a speech in Tynemouth the next day, May said Labour had "deserted" working-class voters, criticised Labour's policy proposals and said Britain's future depended on making a success of Brexit.

    • britain
    • critici
    • voter
    • desert
    • depend
    • speech
    • labour (shared with the claim)
    • said
  3. evidence-1014366

    The Labour Party proposed a renegotiation of the withdrawal agreement (towards a closer post-withdrawal relationship with the EU) and would then put this forward as an option in a referendum alongside the option of remaining in the EU.

    • eu
    • closer
    • withdraw
    • option
    • agreement
    • alongsid
    • labour (shared with the claim)
    • referendum
  4. evidence-462075

    The Liberal Democrats, the Greens, the SNP and Labour all support a ban on fracking, whilst the Conservatives propose approving fracking on a case-by-case basis.

    • approv
    • conserv
    • propo
    • whilst
    • labour (shared with the claim)
    • basi
    • ban
    • liber
    • case
  5. evidence-627910

    Both Cameron and Theresa May have aimed at helping families achieve a work-home balance and have previously proposed to offer all parents 12 months parental leave, to be shared by parents as they choose.

    • achiev
    • aim
    • balanc
    • propo
    • parent
    • cameron
    • choo
    • theresa
    • share
    • leav