Skip to content
Climate Claim Checker

Dev claim · claim-3070 · #45 of 154

“So this is a government which is proposing to put at risk our manufacturing industry, to penalise struggling families, to make a tough situation worse for millions of households right around Australia.”

Claim tags (sorted stems; highlighted when a passage shares them)

  • around
  • australia
  • famili
  • govern
  • household
  • industri
  • make
  • manufactur
  • million
  • penalis
  • propos
  • put
  • right
  • risk
  • situat
  • struggl
  • tough
  • wors

Annotators’ label

Not enough info Run this claim live

The model’s verdict

The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.

Notebook protocol

Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.

Not enough info✓ matches the label
Supports
5.1%
Refutes
1.1%
Not enough info
91.6%
Disputed
2.2%

One claim at a time

The same model run on a single claim, which is how the Try-it page runs it.

Not enough info✓ matches the label
Supports
20.3%
Refutes
4.2%
Not enough info
60.3%
Disputed
15.2%

With gold evidence

Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.

Not enough info✓ matches the label
Supports
2.4%
Refutes
0.4%
Not enough info
95.6%
Disputed
1.5%

Retrieved vs gold evidence

Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.

2024 submission

The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.

Path
not recorded
Found
0 of 5 gold
P
0.00
R
0.00
F
0.00
  1. #1evidence-597214

    It was certified triple platinum by the Recording Industry Association of America (RIAA) for three million units shipped in the United States and has sold over 15 million copies worldwide, becoming one of the best-selling albums during the 2000s century.

    • million (shared with the claim)
    cos
    0.307
    overlap
    1.000
    score
    1.307
    shared
    1
  2. #2evidence-438751

    Upon release, the film received mixed to positive reviews from critics and was a success at the box-office, grossing $ 230 million worldwide from a $ 43 million budget.

    • million (shared with the claim)
    cos
    0.307
    overlap
    1.000
    score
    1.307
    shared
    1
  3. #3evidence-538361

    He is a right-handed batsman and right-arm medium-pace bowler who plays for Moratuwa Sports Club.

    • right (shared with the claim)
    cos
    0.304
    overlap
    1.000
    score
    1.304
    shared
    1
  4. #4evidence-1165122

    James was a right-handed batsman who bowled right-arm medium pace.

    • right (shared with the claim)
    cos
    0.304
    overlap
    1.000
    score
    1.304
    shared
    1
  5. #5evidence-1045773

    He is a right-handed batsman and a right-arm medium pace bowler.

    • right (shared with the claim)
    cos
    0.304
    overlap
    1.000
    score
    1.304
    shared
    1
  6. #6evidence-292698

    Wilshaw is a right-handed batsman who bowls right-arm medium-pace.

    • right (shared with the claim)
    cos
    0.304
    overlap
    1.000
    score
    1.304
    shared
    1

Gold evidence (5)

  1. evidence-137771

    John McDonnell said the IFS analysis showed a “clear threat” to working people’s living standards, while the Liberal Democrats said that the “savage cuts” would make millions of households poorer.

    • cut
    • threat
    • savag
    • household (shared with the claim)
    • analysi
    • said
    • clear
  2. evidence-100483

    Families are forced into increasing poverty, some facing a daily struggle to pay their rent and put food on their table.

    • poverti
    • struggl (shared with the claim)
    • put (shared with the claim)
    • tabl
    • daili
    • pay
    • food
    • face
    • increa
    • rent
  3. evidence-617690

    nearly 4 million UK children are judged to live in households that would find it difficult to afford enough fruit, vegetables and other healthy foods to reach official guidelines, the Food Foundation maintains.

    • nearli
    • fruit
    • enough
    • healthi
    • food
    • afford
    • veget
    • difficult
    • household (shared with the claim)
    • guidelin
  4. evidence-462483

    The upcoming minimum wage rise will help, but many low-income working families will still find themselves worse off due to tax-credit changes.

    • wor
    • incom
    • upcom
    • credit
    • minimum
    • tax
    • find
    • rise
    • wage
  5. evidence-222747

    Fuel poverty affects over a million British working households and over 2.3 million households in total and increases in energy prices affect poor people severely.

    • poverti
    • fuel
    • price
    • increa
    • million (shared with the claim)
    • total
    • poor
    • household (shared with the claim)
    • affect
    • energi