Study Reporting and Appraisal

Checked 2026-09-30.

First Principle

Choose by study purpose, design, and evaluation stage. A reporting guideline states what to report; it does not prove that the study was well designed, unbiased, clinically useful, safe, or effective.

Use risk-of-bias/applicability tools separately and preserve human judgments.

Selection Map

Observational Data

STROBE

STROBE addresses reporting of cohort, case-control, and cross-sectional studies. Use the design-specific checklist and explanation material from the STROBE site.

RECORD

RECORD extends STROBE for routinely collected health data such as administrative, EHR, primary-care surveillance, and registry data. It emphasizes code lists/algorithms, database linkage, selection, cleaning, and data-access transparency. See the RECORD site.

Neither framework authorizes this skill to read EHR rows.

Prediction Models

TRIPOD+AI

TRIPOD+AI, published April 16, 2024, updates reporting guidance for development and evaluation of clinical prediction models using regression or machine-learning methods. It primarily targets non-generative models.

Report, at minimum:

• intended use, target population, outcome, horizon, and setting;
• data sources, eligibility, sampling, and preprocessing;
• predictor/outcome definitions and timing;
• missing data;
• sample-size rationale;
• full model specification or access;
• internal-validation method;
• discrimination and calibration with uncertainty;
• external validation and transportability;
• subgroup performance and fairness considerations;
• intended user, presentation, and limitations.

TRIPOD-LLM

For research documentation concerning LLM development, tuning, prompting, or evaluation, use TRIPOD-LLM, published January 8, 2025. Its modular checklist depends on the research design and task. Record the model/version, prompts, evaluation setting, and human review; it is a reporting guideline, not a model-quality score. This does not add LLM calls, raw text handling, or care delivery to this skill.

PROBAST+AI

PROBAST+AI, published March 24, 2025, replaces the original PROBAST for broad prediction-model assessment. It has two distinct parts:

• model development — quality and applicability;
• model evaluation — risk of bias and applicability.

Both parts use four domains:

1. participants and data sources;
2. predictors;
3. outcome;
4. analysis.

Applicability is assessed for participants/data sources, predictors, and outcome. Do not average signaling questions into a score. Domain and overall judgments require knowledgeable assessors and rationale.

Biomarker Studies

Use the FDA-NIH BEST Glossary (revised January 16, 2025) for terminology. Distinguish categories and roles:

• diagnostic;
• monitoring;
• response, including pharmacodynamic and surrogate-endpoint biomarker roles;
• multicomponent;
• predictive;
• prognostic;
• safety;
• susceptibility/risk.

A biomarker is not itself a measure of how a person feels, functions, or survives. Analytical validation, clinical validation, and clinical utility are distinct.

For tumor prognostic markers, use REMARK. Report specimen handling, assay methods, prespecified hypotheses/cut points, participant flow, missing data, analysis, effect estimates, and validation.

AI Diagnostic Accuracy

STARD-AI was published September 15, 2025. It adds AI-specific or modified items to STARD 2015 for diagnostic-accuracy studies, including:

• dataset practices;
• AI index-test description and evaluation;
• algorithmic bias and fairness;
• applicability and generalizability;
• transparent participant flow and reference-standard handling.

Use STARD-AI with STARD. The July 13, 2026 author correction adds an omitted steering-committee author; it does not replace the checklist. Do not use it for a prognostic prediction model merely because the model returns a class.

AI Trial Protocols and Reports

SPIRIT-AI and CONSORT-AI were published September 9, 2020.

• Use SPIRIT-AI for protocols evaluating an AI intervention.
• Use CONSORT-AI for reports of randomized trials evaluating an AI intervention.
• Apply them with the current generic SPIRIT 2025 or CONSORT 2025 statement, respectively.

The official extension catalogue still groups these AI extensions under SPIRIT 2013 and CONSORT 2010. Crosswalk their AI-specific items to the 2025 base checklists by content; do not assume the old item numbers match or describe them as updated 2025 AI extensions.

AI extensions emphasize the intervention version, input acquisition/quality handling, human-AI interaction, integration requirements, errors/failures, and analysis of performance.

Early Live Evaluation

DECIDE-AI, published May 18, 2022, covers early-stage live clinical evaluation of AI-based decision-support systems and includes human factors, workflow, safety, and iterative change reporting.

Live evaluation affects real care and is outside this skill's execution boundary. Use the guideline only to understand documentation requirements. Such work requires an approved protocol, qualified investigators, safety oversight, validated systems, applicable authorization, and institutional governance.

Cross-Cutting Reporting

Always disclose:

• prespecified versus exploratory work;
• all evaluated outcomes and analyses, including negative results;
• effect sizes and uncertainty;
• missingness and exclusions;
• conflicts, funding, and developer involvement;
• version and data cut dates;
• external validation;
• subgroup representation and performance;
• calibration and decision thresholds;
• human-factors methods;
• incidents, failures, drift, updates, and monitoring;
• access to protocol, analysis plan, code, model, and data when lawful and feasible.

Never state “reported according to” as proof of adherence without a completed checklist and human verification.