SeroTracker-RoB : a decision rule-based algorithm for reproducible risk of bias assessment of seroprevalence studies
SeroTracker-RoB : a decision rule-based algorithm for reproducible risk of bias assessment of seroprevalence studies
Simple item page
Full item details
- dc.contributor.author
- Bobrovitz, Niklas
- Li, Zihan
- Cao, Christian
- Deveaux, Gabriel
- Selemon, Anabel
- Clifton, David A.
- Yanes-Lane, Mercedes
- Yan, Tingting
- Arora, Rahul K.
- Arora, Rahul K.
- dc.date.accessioned
- 2025-01-30T15:05:45Z
- dc.date.available
- 2025-01-30T15:05:45Z
- dc.date.issued
- 2022-11-16
- dc.description.abstract - en
- <p>Background <br>Risk of bias (RoB) assessments are a core element of evidence synthesis but can be time consuming and subjective. We aimed to develop a decision rule-based algorithm for RoB assessment of seroprevalence studies.</p> <p>Methods <br>We developed the SeroTracker-RoB algorithm. The algorithm derives seven objective and two subjective critical appraisal items from the Joanna Briggs Institute Critical Appraisal Checklist for Prevalence studies and implements decision rules that determine study risk of bias based on the items. Decision rules were validated using the SeroTracker seroprevalence study database, which included non-algorithmic RoB judgements from two reviewers. We quantified efficiency as the mean difference in time for the algorithmic and non-algorithmic assessments of 80 randomly selected articles, coverage as the proportion of studies where the decision rules yielded an assessment, and reliability using intraclass correlations comparing algorithmic and non-algorithmic assessments for 2,070 articles.</p> <p>Results <br>A set of decision rules with 61 branches was developed using responses to the nine critical appraisal items. The algorithmic approach was faster than non-algorithmic assessment (mean reduction 2.32 minutes [SD 1.09] per article), classified 100% (n=2,070) of studies, and had good reliability compared to non-algorithmic assessment (ICC 0.77, 95% CI 0.74-0.80). We built the SeroTracker-RoB Excel Tool which embeds this algorithm for use by other researchers.</p> <p>Conclusions <br>The SeroTracker-RoB decision-rule based algorithm was faster than non-algorithmic assessment with complete coverage and good reliability. This algorithm enabled rapid, transparent, and reproducible RoB evaluations of seroprevalence studies and may support evidence synthesis efforts during future disease outbreaks. This decision rule-based approach could be applied to other types of prevalence studies.</p>
- dc.description.sponsorship
- SeroTracker receives funding for SARS-CoV-2 seroprevalence study evidence synthesis from the Public Health Agency of Canada through Canada's COVID-19 Immunity Task Force, the World Health Organization Health Emergencies Programme, the Robert Koch Institute, and the Canadian Medical Association Joule Innovation Fund.
- dc.identifier.doi
- https://doi.org/10.1101/2021.11.17.21266471
- dc.identifier.uri
- https://open-science.canada.ca/handle/123456789/3382
- dc.language.iso
- en
- dc.publisher - en
- medRxiv
- dc.relation.isreplacedby
- https://doi.org/10.1002/jrsm.1620
- dc.rights - en
- Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)
- dc.rights - fr
- Creative Commons Attribution - Pas d'utilisation commerciale - Pas de modification 4.0 International (CC BY-NC-ND 4.0)
- dc.rights.openaccesslevel - en
- Green
- dc.rights.openaccesslevel - fr
- Vert
- dc.rights.uri - en
- https://creativecommons.org/licenses/by-nc-nd/4.0/
- dc.rights.uri - fr
- https://creativecommons.org/licenses/by-nc-nd/4.0/deed.fr
- dc.subject - en
- Health
- Infectious diseases
- dc.subject - fr
- Santé
- Maladie infectieuse
- dc.subject.en - en
- Health
- Infectious diseases
- dc.subject.fr - fr
- Santé
- Maladie infectieuse
- dc.title - en
- SeroTracker-RoB : a decision rule-based algorithm for reproducible risk of bias assessment of seroprevalence studies
- dc.type - en
- Submitted manuscript
- dc.type - fr
- Manuscrit soumis
- local.pagination
- 1-19
- local.peerreview - en
- No
- local.peerreview - fr
- Non
Download(s)
Original bundle
1 - 1 of 1
Name: bobrovitz-serotracker-rob-algorithm-risk-of-bias-assessment-seroprevalence-studies.pdf
Size: 639.8 KB
Format: PDF
Collection(s)