reporting_standards.md
253 lines · skills/peer-review/references/reporting_standards.md at 5f2bc03
Most marks come from matching words in the file, so treat them as pointers.
Reporting Guidelines and Domain Metadata Standards
Reviewed against primary or official sources on 2026-10-01; source-specific access limitations are recorded in the ledger. The dated evidence record is assets/source_ledger.csv; the machine-readable selector catalog is assets/reporting_guidelines.json.
What reporting guidelines do—and do not do
A reporting guideline identifies information that should be reported so readers can understand and appraise a study. It is not, by itself:
- A method for designing or conducting the study
- A risk-of-bias tool
- A statistical reanalysis
- A measure of truth, importance, novelty, or manuscript merit
- A publication recommendation
Checklist completion must never be converted automatically into a quality score. A fully reported study can have serious design problems; an incompletely reported study may be impossible to assess. Record missing information as a reporting gap, then separately assess any design, conduct, analysis, reproducibility, or ethics concern using appropriate evidence and expertise.
Use the guideline’s current statement together with its explanation and elaboration. Check applicable extensions and the target venue’s instructions. Do not copy checklist wording into a review when a specific, contextual comment is more useful.
Raw lines 5 to 18Selection workflow
- Identify the report kind: results, protocol, abstract, or data release.
- Identify the study design, not merely the topic or journal section.
- Add cross-cutting features: AI intervention, diagnostic AI, routinely collected data, clustered design, qualitative interviews, and so on.
- Select the current base guideline and applicable extensions.
- Use the official checklist to record
reported,partly_reported,not_reported,not_applicable, ornot_assessed. - Explain
not_applicable; do not treat it as a defect. - Keep reporting coverage separate from methodological appraisal.
Run:
python3 scripts/select_reporting_guidelines.py \
assets/study_profile_template.json \
--coverage assets/reporting_checklist_template.csvThe bundled catalog is a dated aid, not a live registry. Consult the EQUATOR Network and official guideline site when the study type is unclear or a newer extension may apply.
Raw lines 19 to 38Major current health-research guidelines
Raw lines 39 to 40Randomized trial results — CONSORT 2025
- Current statement: CONSORT 2025, published 14 April 2025
- Structure: 30 main checklist items and a participant flow diagram
- Supersedes: CONSORT 2010
- Use for: reports of randomized trials
- Review with: explanation and elaboration plus design/intervention extensions
- Important boundary: the statement explicitly says it is not a quality assessment instrument
Check registration, protocol and statistical analysis plan consistency, allocation, participant flow, outcomes and harms, effect estimates and uncertainty, protocol changes, data sharing, conflicts, and patient/public involvement where applicable.
Official sources: CONSORT–SPIRIT and the CONSORT 2025 statement.
Raw lines 41 to 53Randomized trial protocols — SPIRIT 2025
- Current statement: SPIRIT 2025, published 28 April 2025
- Structure: 34 main checklist items and a participant timeline
- Supersedes: SPIRIT 2013
- Use for: randomized trial protocols
Compare the protocol with registration, statistical analysis plan, ethics records, amendments, and any completed-trial report. Explicitly stated non-applicability with rationale is not missing reporting.
Official sources: CONSORT–SPIRIT and the SPIRIT 2025 statement.
Raw lines 54 to 64Systematic reviews — PRISMA 2020
- Current statement: PRISMA 2020 (named 2020; published 2021)
- Structure: 27 main items, expanded checklist, abstract checklist, and flow diagrams
- Use for: completed systematic reviews, primarily reviews of intervention effects
- Protocols: use PRISMA-P
- Extensions: use the appropriate extension for scoping, diagnostic, individual-participant-data, network, equity, harms, or other specialized reviews
PRISMA explicitly does not assess review conduct or methodological quality. Use appropriate methods and risk-of-bias tools separately.
Official sources: PRISMA 2020 resources and the primary statement.
Raw lines 65 to 76Observational studies — STROBE
- Current base statement: STROBE 2007
- Structure: 22 main items with cohort, case-control, cross-sectional, and combined checklists
- Use for: reports of observational epidemiologic studies
- Extensions: examples include RECORD for routinely collected health data, STREGA for genetic association studies, STROBE-MR, and domain-specific extensions
STROBE helps identify whether selection, measurement, bias, confounding, missing data, sensitivity analyses, and generalizability are reported. It does not establish that those methods were adequate.
Official source: STROBE.
Raw lines 77 to 87Diagnostic accuracy — STARD 2015
- Current base statement: STARD 2015
- Structure: 30 main items and a flow diagram
- Use for: studies estimating diagnostic accuracy against a reference standard
Separately assess risk of bias and applicability with a suitable tool such as the current QUADAS family when relevant. STARD’s official implementation guidance explicitly says not to use the reporting checklist as a design-quality tool.
Official source: STARD 2015.
Raw lines 88 to 97AI-centered diagnostic accuracy — STARD-AI
- Current statement: STARD-AI 2025
- Published: 15 September 2025; an author correction was published 13 July 2026
- Structure: 40 items, including 18 new or modified items relative to STARD 2015
- Use for: AI-centered diagnostic accuracy studies, including suitable diagnostic classification tasks
Check dataset practices, index-test specification, evaluation, algorithmic bias and fairness, applicability, and generalizability. If the primary aim is development or evaluation of a multivariable prediction model, use TRIPOD+AI instead.
Official source: STARD-AI.
Raw lines 98 to 108Clinical prediction models — TRIPOD+AI
- Current statement: TRIPOD+AI 2024
- Structure: 27 main items plus a 13-item abstract checklist
- Replaces: TRIPOD 2015
- Use for: development, evaluation, or updating of diagnostic or prognostic prediction models using regression or machine-learning methods
Do not select it solely because software called “AI” appears in a paper. Select it when the study’s primary object is a prediction model. Relevant extensions include TRIPOD-Cluster, TRIPOD-SRMA, and TRIPOD-LLM.
Official sources: TRIPOD and the TRIPOD+AI statement.
Raw lines 109 to 119Case reports — CARE
- Current base checklist: CARE 2013
- Explanation and elaboration/manual: 2017
- Structure: 13 main items
- Use for: clinical case reports
Check timeline, diagnostic reasoning, interventions, outcomes, adverse events, patient perspective where available, informed consent, privacy, and venue requirements.
Official source: CARE checklist.
Raw lines 120 to 130In vivo animal research — ARRIVE 2.0
- Current statement: ARRIVE 2.0, published July 2020
- Structure: Essential 10 plus 11 Recommended Set items
- Use for: research involving live animals across bioscience disciplines
The Essential 10 are a minimum reporting set, not a ranking. Review study design, sample size, inclusion/exclusion, randomization, blinding, outcome measures, statistics, animal details, procedures, and results; also assess ethics, welfare, humane endpoints, adverse events, protocol registration, data access, and interests.
Official source: ARRIVE 2.0.
Raw lines 131 to 140Quality improvement — SQUIRE 2.0
- Current statement: SQUIRE 2.0, published 2015
- Structure: 18 main items
- Use for: system-level work intended to improve healthcare quality, safety, value, or equity where methods seek to relate outcomes to the intervention
SQUIRE states that every item should be considered, but not every element belongs in every manuscript. Attend to local context, rationale, intervention evolution, measures, analysis, ethics, unintended consequences, and sustainability.
Official source: SQUIRE 2.0.
Raw lines 141 to 150Health economic evaluations — CHEERS 2022
- Current statement: CHEERS 2022
- Structure: 28 main items
- Replaces: CHEERS 2013
- Use for: economic evaluations of health interventions
Assess perspective, comparators, time horizon, discounting, outcome and cost measurement, model assumptions, heterogeneity, distributional effects where applicable, uncertainty, engagement, funding, and conflicts. Use a separate critical-appraisal framework for methodological quality.
Official source: ISPOR CHEERS.
Raw lines 151 to 161Qualitative research — SRQR and COREQ
- SRQR: broad qualitative research reporting standard
- COREQ: 32-item checklist specifically for interviews and focus groups
Select by methods, not by the presence of quotations. Review researcher reflexivity, sampling, context, data collection, analytic process, credibility, participant voice, ethics, and limitations without imposing one epistemology on all qualitative traditions.
Official registry records: SRQR and COREQ.
Raw lines 162 to 170AI extensions and overlap
Use the guideline that matches the study’s primary design and claim:
- Randomized trial of an AI intervention: CONSORT 2025 plus CONSORT-AI 2020
- Protocol for such a trial: SPIRIT 2025 plus SPIRIT-AI 2020
- AI diagnostic accuracy: STARD-AI
- Prediction model development or performance evaluation: TRIPOD+AI
- Biomedical LLM development, tuning, prompt engineering, or evaluation, including non-prediction tasks: TRIPOD-LLM 2025; add TRIPOD+AI when prediction-model reporting also applies
- Medical imaging AI: consider current modality guidance in addition to the design-specific base
The 2020 AI extensions were written against CONSORT 2010 and SPIRIT 2013. Use their substantive requirements with the current base guidelines, mapping by meaning rather than reusing old item numbers. The official extension index distinguishes extensions built on the 2025 checklists from those built on the previous versions. CONSORT-AI and SPIRIT-AI remain listed in EQUATOR.
TRIPOD-LLM has 19 main items and a separate abstract checklist. In the local selector, llm_study with feature large_language_model selects it without incorrectly classifying a summarization or question-answering evaluation as a prediction model. See the TRIPOD-LLM record.
Multiple guidelines can apply, but do not create redundant demands. State which base and extension address each concern. The catalog is intentionally selective: abstract-specific checklists and many extensions require manual selection from the official source.
Raw lines 171 to 187Domain metadata standards: verified legacy status
These standards describe minimum experiment or repository metadata. They complement, rather than replace, study-design reporting and methodological appraisal.
Raw lines 188 to 191MIAME and MINSEQE
Retain with qualification. NCBI GEO’s official guidance states that its submission procedures support:
- MIAME for microarray experiments
- MINSEQE for high-throughput functional genomics sequencing experiments
The October 2026 live fetch returned a browser challenge; official search-indexed GEO guidance still describes both standards. Verify the current repository’s fields, file formats, raw/processed data expectations, and accession requirements; do not treat this as an executed repository submission check.
Official implementation source: GEO and MIAME/MINSEQE.
Raw lines 192 to 202MIAPE
Retain as a modular current-qualified standard. The HUPO Proteomics Standards Initiative lists released components with separate versions, including mass spectrometry, mass-spectrometry informatics, quantification, gel electrophoresis, gel informatics, chromatography, and capillary electrophoresis.
Select only components relevant to the actual workflow and verify current repository expectations. Do not present “MIAPE” as one unversioned universal checklist.
Official source: HUPO-PSI MIAPE.
Raw lines 203 to 210MIFlowCyt
Retain with qualification. ISAC continues to identify MIFlowCyt 1.0 as an ISAC recommendation for experiment overview, samples, instrumentation, and data analysis. Also check current FCS, gating, panel, controls, and FlowRepository requirements.
Official source: ISAC MIFlowCyt.
Raw lines 211 to 216MIAPPE
Use MIAPPE 1.2, released October 2024, for plant phenotyping metadata. It remains compatible with 1.1; version 2.0 was still in early development on the verification date.
Official source: MIAPPE releases.
Raw lines 217 to 222MIGS and MIMS
Do not present standalone MIGS/MIMS as the current umbrella. The Genomic Standards Consortium now organizes these legacy checklists within MIxS (Minimum Information about any Sequence), alongside newer checklists and environmental packages. Select the current MIxS release and applicable checklist plus environmental extension; GSC now calls their pairing a combination (older documents use package).
Official source: GSC standards.
Raw lines 223 to 228Other study types
The EQUATOR database contains hundreds of guidelines. Common additional choices include:
- Protocols: design-specific protocol guidance
- Routinely collected health data: RECORD
- Clinical practice guidelines: RIGHT and AGREE reporting guidance
- Surveys: design-appropriate survey reporting guidance
- Implementation studies: current implementation-reporting guidance
- Mixed methods: current mixed-methods guidance
- Laboratory and omics studies: study-design reporting plus current repository metadata standards
If no suitable guideline exists, say so. Do not force the nearest checklist or invent one.
Raw lines 229 to 242Coverage language for reviews
Use:
“Item 12 is not reported clearly enough to determine the analysis population. Please identify the included participants and reconcile this denominator with Figure 1.”
Avoid:
“The manuscript scores 18/30 on CONSORT and is therefore low quality.”
Report counts or item identifiers only as navigation aids. The local selector deliberately emits no percentage or merit score.
Raw lines 243 to 253