Dev claim · claim-871 · #4 of 154
““As it happens, Zika may also be a good model of the second worrying effect — disease mutation.”
Claim tags (sorted stems; highlighted when a passage shares them)
- also
- diseas
- effect
- good
- happen
- may
- model
- mutat
- second
- worri
- zika
The model’s verdict
The Transformer retrained from the notebook (the 2024 weights were never saved), shown three ways. The first is how the notebook evaluated it.
Notebook protocol
Dev claims predicted in batches of 16, in file order, from the 2024 retrieved evidence, as the notebook does.
- Supports
- 58.5%
- Refutes
- 35.0%
- Not enough info
- 1.4%
- Disputed
- 5.1%
One claim at a time
The same model run on a single claim, which is how the Try-it page runs it.
- Supports
- 53.1%
- Refutes
- 38.4%
- Not enough info
- 5.2%
- Disputed
- 3.3%
With gold evidence
Fed the human-annotated evidence instead of retrieved passages. This is the 'val accuracy' the training loop reports.
- Supports
- 21.7%
- Refutes
- 5.0%
- Not enough info
- 63.4%
- Disputed
- 9.9%
Retrieved vs gold evidence
Gold passages were picked by the dataset’s annotators. Retrieved passages are what the TF-IDF rule returned from all 1.19M passages. Switch between the submitted 2024 output and the re-runs.
2024 submission
The passages the team actually retrieved and submitted in 2024 (their saved output file). The file records only passage ids, so scores are recomputed with the submission rule.
- Path
- not recorded
- Found
- 0 of 5 gold
- P
- 0.00
- R
- 0.00
- F
- 0.00
#1evidence-133336 Effectiveness may also be worsened by countermeasures.
- worsen
- may (shared with the claim)
- also (shared with the claim)
- effect (shared with the claim)
- cos
- 0.660
- overlap
- 0.750
- score
- 1.410
- shared
- 3
Gold evidence (5)
evidence-422399 Genetic disorders are the result of deleterious mutations and can be due to spontaneous mutation in the affected individual, or can be inherited.
- result
- spontan
- individu
- due
- mutat (shared with the claim)
- affect
- inherit
- genet
- disord
evidence-702226 These errors, called mutations, can affect the phenotype of an organism, especially if they occur within the protein coding sequence of a gene.
- sequenc
- phenotyp
- code
- protein
- gene
- especi
- mutat (shared with the claim)
- affect
- error
- occur
evidence-286834 This is especially useful studying diseases in adults by allowing expression after a certain period of growth, thus eliminating the deleterious effect of gene expression seen during stages of development in model organisms.
- elimin
- adult
- thu
- certain
- seen
- gene
- especi
- growth
- disea
- express
evidence-472751 In addition, research was needed to determine the mechanism by which Zika produced these effects.
- mechan
- need
- research
- produc
- effect (shared with the claim)
- addit
- determin
evidence-641043 Zika also appears to have an equal tropism for cells of the developing eye, leading to high rates of eye abnormalities as well.
- abnorm
- rate
- eye
- appear
- equal
- well
- cell
- high
- lead