Skill Tracer
Skills › Scientific Agent Skills › peer-review › ethical_review_practice.md

ethical_review_practice.md

235 lines · skills/peer-review/references/ethical_review_practice.md at 5f2bc03

Open on GitHub

Most marks come from matching words in the file, so treat them as pointers.

1# Ethical and Confidential Peer Review
2
3Reviewed on **2026-10-01** against COPE, ICMJE, and illustrative publisher policies listed in `assets/source_ledger.csv`. Source-specific access limits and dates are recorded there.
4
5COPE’s current membership framework is its [Code of Conduct](https://publicationethics.org/membership/code-of-conduct), published 21 July 2026 with a 12-month implementation transition. It replaces the 2017 Core Practices, which were [retired in 2024](https://publicationethics.org/about/what-we-do/our-story/history-code-conduct). This membership framework is distinct from the still-current reviewer-specific **Ethical Guidelines for Peer Reviewers, version 2 (2017)** used below. The target journal’s published process controls the individual assignment.
6

Ethical and Confidential Peer Review

Reviewed on 2026-10-01 against COPE, ICMJE, and illustrative publisher policies listed in assets/source_ledger.csv. Source-specific access limits and dates are recorded there.

COPE’s current membership framework is its Code of Conduct, published 21 July 2026 with a 12-month implementation transition. It replaces the 2017 Core Practices, which were retired in 2024. This membership framework is distinct from the still-current reviewer-specific Ethical Guidelines for Peer Reviewers, version 2 (2017) used below. The target journal’s published process controls the individual assignment.

Raw lines 1 to 6
7## Role boundary
8
9This skill supports an accountable human preparing a review draft or structured assessment. It must not:
11- Claim to be the assigned reviewer, editor, journal, funder, or decision-maker
12- Submit a review or contact authors, editors, institutions, or third parties without authorization
13- Invent manuscript content, experiments, analyses, citations, reviewer identity, or editorial outcomes
14- Present generated text as an independently completed review
15- Investigate authors or search unpublished content outside the authorized process
17The editor decides the editorial outcome. The reviewer provides evidence-bounded advice within the requested scope.

Role boundary

This skill supports an accountable human preparing a review draft or structured assessment. It must not:

  • Claim to be the assigned reviewer, editor, journal, funder, or decision-maker
  • Submit a review or contact authors, editors, institutions, or third parties without authorization
  • Invent manuscript content, experiments, analyses, citations, reviewer identity, or editorial outcomes
  • Present generated text as an independently completed review
  • Investigate authors or search unpublished content outside the authorized process

The editor decides the editorial outcome. The reviewer provides evidence-bounded advice within the requested scope.

Raw lines 7 to 18
19## Before accepting or starting
21COPE’s Ethical Guidelines for Peer Reviewers and ICMJE recommendations require reviewers to consider:

Before accepting or starting

COPE’s Ethical Guidelines for Peer Reviewers and ICMJE recommendations require reviewers to consider:

Raw lines 19 to 22
23### Competence
25- Accept only work for which the reviewer can provide a useful assessment.
26- State material subject-matter, methods, statistics, ethics, language, or domain limits.
27- Ask the editor for a specialist reviewer when a central issue exceeds competence.
28- Do not conceal limits by producing confident generic criticism.

Competence

  • Accept only work for which the reviewer can provide a useful assessment.
  • State material subject-matter, methods, statistics, ethics, language, or domain limits.
  • Ask the editor for a specialist reviewer when a central issue exceeds competence.
  • Do not conceal limits by producing confident generic criticism.
Raw lines 23 to 29
30### Conflicts
32Disclose actual, potential, or perceived conflicts before proceeding. They can be:
34- Financial or commercial
35- Personal or family
36- Institutional
37- Recent collaboration, supervision, mentorship, or competition
38- Intellectual commitments or directly competing work
39- Political, religious, advocacy, or legal interests
41The journal decides whether a disclosed conflict permits review. If unresolved, stop. In the intake, `disclosed_to_editor` remains blocked; record `editor_cleared` only after clearance. Do not accept merely to gain access to unpublished work.

Conflicts

Disclose actual, potential, or perceived conflicts before proceeding. They can be:

  • Financial or commercial
  • Personal or family
  • Institutional
  • Recent collaboration, supervision, mentorship, or competition
  • Intellectual commitments or directly competing work
  • Political, religious, advocacy, or legal interests

The journal decides whether a disclosed conflict permits review. If unresolved, stop. In the intake, disclosed_to_editor remains blocked; record editor_cleared only after clearance. Do not accept merely to gain access to unpublished work.

Raw lines 30 to 42
43### Capacity and timeliness
45Accept only if the review can be completed within the agreed time. Tell the editor promptly if scope or timing changes.

Capacity and timeliness

Accept only if the review can be completed within the agreed time. Tell the editor promptly if scope or timing changes.

Raw lines 43 to 46
47### Journal policy
49Record:
51- Review model and anonymity expectations
52- Whether co-review is allowed and how contributors are named
53- Confidentiality and retention requirements
54- Required author-facing and editor-only fields
55- AI and tool policy
56- Citation, image-integrity, data, ethics, and reporting expectations
58Journal practices differ. A policy from another publisher is an example, not authority for the target venue.
60Use `scripts/validate_review_intake.py` before substantive review.

Journal policy

Record:

  • Review model and anonymity expectations
  • Whether co-review is allowed and how contributors are named
  • Confidentiality and retention requirements
  • Required author-facing and editor-only fields
  • AI and tool policy
  • Citation, image-integrity, data, ethics, and reporting expectations

Journal practices differ. A policy from another publisher is an example, not authority for the target venue.

Use scripts/validate_review_intake.py before substantive review.

Raw lines 47 to 61
Runs code scripts/validate_review_intake.py :60
62## Confidentiality and data handling
64An unpublished manuscript, its supplements, review comments, and editorial correspondence are privileged confidential material.

Confidentiality and data handling

An unpublished manuscript, its supplements, review comments, and editorial correspondence are privileged confidential material.

Raw lines 62 to 65
66### Default rule
68Keep processing local. Do not send, paste, upload, transcribe, summarize, or expose unpublished manuscript or review text to:
70- Public or external generative-AI systems
71- Search engines or web research tools
72- Citation, plagiarism, grammar, translation, or image services
73- Unapproved collaborators
74- Cloud storage or telemetry outside the authorized environment
76unless the publisher or author has authorized that specific use, the target venue permits it, and applicable privacy, contract, intellectual-property, and data-governance requirements are satisfied.
78Authorization to review is not automatically authorization to disclose material to a service. A tool’s promise not to train on data is not, by itself, authorization.
80A hosted assistant reading a file is external processing even when its shell or bundled validator executes locally. Do not confuse the CLI's local-only behavior with the assistant platform's handling of content.
82The bundled CLIs:
84- Use only Python’s standard library
85- Read bounded local JSON, CSV, or Markdown
86- Make no network, model, image, subprocess, environment-variable, or dynamic-code calls
87- Emit identifiers, counts, rule codes, and line numbers rather than raw manuscript or review text
88- Refuse symlink inputs and implicit output overwrite
90They do not make an external service safe and do not authorize its use.

Default rule

Keep processing local. Do not send, paste, upload, transcribe, summarize, or expose unpublished manuscript or review text to:

  • Public or external generative-AI systems
  • Search engines or web research tools
  • Citation, plagiarism, grammar, translation, or image services
  • Unapproved collaborators
  • Cloud storage or telemetry outside the authorized environment

unless the publisher or author has authorized that specific use, the target venue permits it, and applicable privacy, contract, intellectual-property, and data-governance requirements are satisfied.

Authorization to review is not automatically authorization to disclose material to a service. A tool’s promise not to train on data is not, by itself, authorization.

A hosted assistant reading a file is external processing even when its shell or bundled validator executes locally. Do not confuse the CLI's local-only behavior with the assistant platform's handling of content.

The bundled CLIs:

  • Use only Python’s standard library
  • Read bounded local JSON, CSV, or Markdown
  • Make no network, model, image, subprocess, environment-variable, or dynamic-code calls
  • Emit identifiers, counts, rule codes, and line numbers rather than raw manuscript or review text
  • Refuse symlink inputs and implicit output overwrite

They do not make an external service safe and do not authorize its use.

Raw lines 66 to 91
92### Assistance and co-review
94Obtain journal permission before sharing with a trainee or colleague. Record the contributor and acknowledge the contribution to the editor as required. The invited reviewer remains responsible for confidentiality and the submitted report.

Assistance and co-review

Obtain journal permission before sharing with a trainee or colleague. Record the contributor and acknowledge the contribution to the editor as required. The invited reviewer remains responsible for confidentiality and the submitted report.

Raw lines 92 to 95
96### No reuse
98Do not:
100- Appropriate ideas, methods, code, data, or language before publication
101- Use the material for model training, benchmarking, product improvement, or unrelated research
102- Build a private corpus of manuscripts or reviews
103- Retain content for convenience beyond policy

No reuse

Do not:

  • Appropriate ideas, methods, code, data, or language before publication
  • Use the material for model training, benchmarking, product improvement, or unrelated research
  • Build a private corpus of manuscripts or reviews
  • Retain content for convenience beyond policy
Raw lines 96 to 104
105### Retention and deletion
107After submitting or ending the review:
1091. Follow the target venue’s retention rule.
1102. Delete local manuscript and review copies when required.
1113. Empty derivative exports and temporary files within the authorized workspace.
1124. Retain only what policy requires.
1135. Record deletion or authorized retention without copying confidential content into the record.
115ICMJE recommends that reviewers not retain manuscripts for personal use and delete copies after review. Local law, publisher policy, or a documented investigation may impose a different rule; follow the controlling requirement.

Retention and deletion

After submitting or ending the review:

  1. Follow the target venue’s retention rule.
  2. Delete local manuscript and review copies when required.
  3. Empty derivative exports and temporary files within the authorized workspace.
  4. Retain only what policy requires.
  5. Record deletion or authorized retention without copying confidential content into the record.

ICMJE recommends that reviewers not retain manuscripts for personal use and delete copies after review. Local law, publisher policy, or a documented investigation may impose a different rule; follow the controlling requirement.

Raw lines 105 to 116
117## AI and automated assistance
119ICMJE says reviewers must follow the journal’s AI policy or request permission before using AI, maintain confidentiality, disclose use, and remain responsible for output that may be incorrect, incomplete, or biased.
121For any permitted assistance:
123- Identify the tool, version, purpose, and material exposed
124- Use only the minimum necessary content
125- Keep an accountable human in control
126- Verify every statement, citation, calculation, and proposed comment
127- Disclose use exactly as the journal requires
128- Do not let a model create an autonomous review or editorial outcome
130If permission is absent, the policy is unclear, or confidentiality cannot be assured, do not use AI on the material. Local deterministic checks may still be possible if policy and authorization permit local file processing.
132Illustrative policies, not universal rules:
134- [Nature Portfolio's current AI policy](https://www.nature.com/nature-portfolio/editorial-policies/ai) permits support under human accountability and disclosure, prohibits sharing manuscript content with unsecured/public AI tools, and prohibits delegating critique or judgment. Some [reviewer instructions](https://www.nature.com/nature/for-referees/policies-and-processes) still state a broader no-upload rule. Check the instructions for the actual journal and assignment; seek editor clarification when policies conflict.
135- [BMJ](https://authors.bmj.com/policies/ai-use) requires declaration of AI used for review-language assistance and prohibits placing unpublished material into publicly available tools when confidentiality cannot be guaranteed.
136- [JAMA Network's 2023 published guidance](https://jamanetwork.com/journals/jama/fullarticle/2807956) states that entering manuscript, abstract, or review text into a chatbot or language model violates its confidentiality agreement and requires disclosure of other AI resource use. This dated article is an example; verify the current invitation and reviewer instructions.
138Always check the current target-venue policy.

AI and automated assistance

ICMJE says reviewers must follow the journal’s AI policy or request permission before using AI, maintain confidentiality, disclose use, and remain responsible for output that may be incorrect, incomplete, or biased.

For any permitted assistance:

  • Identify the tool, version, purpose, and material exposed
  • Use only the minimum necessary content
  • Keep an accountable human in control
  • Verify every statement, citation, calculation, and proposed comment
  • Disclose use exactly as the journal requires
  • Do not let a model create an autonomous review or editorial outcome

If permission is absent, the policy is unclear, or confidentiality cannot be assured, do not use AI on the material. Local deterministic checks may still be possible if policy and authorization permit local file processing.

Illustrative policies, not universal rules:

  • Nature Portfolio's current AI policy permits support under human accountability and disclosure, prohibits sharing manuscript content with unsecured/public AI tools, and prohibits delegating critique or judgment. Some reviewer instructions still state a broader no-upload rule. Check the instructions for the actual journal and assignment; seek editor clarification when policies conflict.
  • BMJ requires declaration of AI used for review-language assistance and prohibits placing unpublished material into publicly available tools when confidentiality cannot be guaranteed.
  • JAMA Network's 2023 published guidance states that entering manuscript, abstract, or review text into a chatbot or language model violates its confidentiality agreement and requires disclosure of other AI resource use. This dated article is an example; verify the current invitation and reviewer instructions.

Always check the current target-venue policy.

Raw lines 117 to 139
140## Preparing the report
142COPE and ICMJE emphasize constructive, honest, polite, fair, and timely comments.

Preparing the report

COPE and ICMJE emphasize constructive, honest, polite, fair, and timely comments.

Raw lines 140 to 143
144### Evidence and proportionality
146- Anchor every consequential criticism to a location and reason.
147- Distinguish missing reporting from demonstrated methodological error.
148- Explain why the issue changes validity, interpretation, reproducibility, ethics, or reader understanding.
149- Request the least burdensome adequate remedy.
150- Label optional suggestions as optional.
151- Do not expand the study beyond its stated scope merely to satisfy reviewer preference.
152- Do not request citations to benefit the reviewer or associates.

Evidence and proportionality

  • Anchor every consequential criticism to a location and reason.
  • Distinguish missing reporting from demonstrated methodological error.
  • Explain why the issue changes validity, interpretation, reproducibility, ethics, or reader understanding.
  • Request the least burdensome adequate remedy.
  • Label optional suggestions as optional.
  • Do not expand the study beyond its stated scope merely to satisfy reviewer preference.
  • Do not request citations to benefit the reviewer or associates.
Raw lines 144 to 153
154### Tone
156Critique the work, not the people. Avoid:
158- Insults, sarcasm, ridicule, threats, or speculation about competence or motives
159- Language policing unrelated to scientific clarity
160- Bias based on identity, institution, location, seniority, language, or reputation
161- Accusations when the evidence supports only a question or discrepancy
162- Vague commands such as “redo the statistics” or “needs more work”
164Use direct language without hostility:
166> “The analysis appears to treat three observations per participant as independent. Please define the analysis unit and account for within-participant dependence, or explain why independence is justified.”

Tone

Critique the work, not the people. Avoid:

  • Insults, sarcasm, ridicule, threats, or speculation about competence or motives
  • Language policing unrelated to scientific clarity
  • Bias based on identity, institution, location, seniority, language, or reputation
  • Accusations when the evidence supports only a question or discrepancy
  • Vague commands such as “redo the statistics” or “needs more work”

Use direct language without hostility:

“The analysis appears to treat three observations per participant as independent. Please define the analysis unit and account for within-participant dependence, or explain why independence is justified.”
Raw lines 154 to 167
168### Requests for additional work
170Request a new experiment or analysis only when it is necessary and proportionate to evaluate or support a central claim. State:
172- Which claim depends on it
173- Why existing evidence is insufficient
174- Whether a narrower claim, correction, sensitivity analysis, or limitation would be an adequate alternative
176Do not turn review into an opportunity to redesign the authors’ research program.

Requests for additional work

Request a new experiment or analysis only when it is necessary and proportionate to evaluate or support a central claim. State:

  • Which claim depends on it
  • Why existing evidence is insufficient
  • Whether a narrower claim, correction, sensitivity analysis, or limitation would be an adequate alternative

Do not turn review into an opportunity to redesign the authors’ research program.

Raw lines 168 to 177
178## Separate communication channels

Separate communication channels

Raw lines 178 to 179
180### Comments to authors
182Include:
184- Neutral summary of the work actually reviewed
185- Specific strengths
186- Major comments affecting validity, interpretation, reproducibility, ethics, or central claims
187- Minor comments affecting clarity, consistency, figures, tables, citations, or reporting
188- Review limitations and unavailable materials when useful
190Do not include:
192- Reviewer identity when policy requires anonymity
193- Unnecessary personal information
194- Editor-only conflict details
195- Accusations or investigative instructions
196- An editorial outcome presented as decided

Comments to authors

Include:

  • Neutral summary of the work actually reviewed
  • Specific strengths
  • Major comments affecting validity, interpretation, reproducibility, ethics, or central claims
  • Minor comments affecting clarity, consistency, figures, tables, citations, or reporting
  • Review limitations and unavailable materials when useful

Do not include:

  • Reviewer identity when policy requires anonymity
  • Unnecessary personal information
  • Editor-only conflict details
  • Accusations or investigative instructions
  • An editorial outcome presented as decided
Raw lines 180 to 197
198### Confidential comments to editor
200Use only for matters that require a separate channel:
202- Reviewer conflicts or competence limits
203- Permission, confidentiality, or AI-use disclosures
204- Credible ethics, integrity, duplicate-publication, image, or security concerns
205- Reasons an issue cannot safely be raised directly with authors
206- Requests for specialist review
208Ordinary scientific criticism should not appear only in the editor channel. Do not write a harsher private review that contradicts the author-facing report. The bundled scaffold keeps these channels visibly separate.

Confidential comments to editor

Use only for matters that require a separate channel:

  • Reviewer conflicts or competence limits
  • Permission, confidentiality, or AI-use disclosures
  • Credible ethics, integrity, duplicate-publication, image, or security concerns
  • Reasons an issue cannot safely be raised directly with authors
  • Requests for specialist review

Ordinary scientific criticism should not appear only in the editor channel. Do not write a harsher private review that contradicts the author-facing report. The bundled scaffold keeps these channels visibly separate.

Raw lines 198 to 209
210## Suspected integrity problems
212Reviewers identify concerns; they do not adjudicate misconduct.
2141. Preserve confidentiality.
2152. Record the exact location and observable discrepancy.
2163. Describe uncertainty and plausible benign explanations.
2174. Notify the editor through the designated confidential route.
2185. Do not contact authors, institutions, journals, funders, or media independently.
2196. Do not run external similarity, face-recognition, image, or data-search services on confidential material without authorization.
2207. Follow editor instructions and retain or delete evidence according to policy.
222Use “Figure 3 appears similar to Figure 5 after rotation; please assess under the journal’s image-integrity process,” not “the authors fabricated the data.”

Suspected integrity problems

Reviewers identify concerns; they do not adjudicate misconduct.

  1. Preserve confidentiality.
  2. Record the exact location and observable discrepancy.
  3. Describe uncertainty and plausible benign explanations.
  4. Notify the editor through the designated confidential route.
  5. Do not contact authors, institutions, journals, funders, or media independently.
  6. Do not run external similarity, face-recognition, image, or data-search services on confidential material without authorization.
  7. Follow editor instructions and retain or delete evidence according to policy.

Use “Figure 3 appears similar to Figure 5 after rotation; please assess under the journal’s image-integrity process,” not “the authors fabricated the data.”

Raw lines 210 to 223
224## Final ethical check
226- Authorization and role are documented.
227- Conflicts are resolved or disclosed.
228- Competence limits and specialist needs are stated.
229- Target-venue policy and review model are known.
230- No unauthorized person or service received confidential material.
231- AI or other assistance is permitted and disclosed.
232- Author and editor channels are separate.
233- Every criticism is specific, evidence-backed, proportionate, and professional.
234- No invented citation, analysis, experiment, or editorial outcome appears.
235- Deletion or authorized retention is planned.

Final ethical check

  • Authorization and role are documented.
  • Conflicts are resolved or disclosed.
  • Competence limits and specialist needs are stated.
  • Target-venue policy and review model are known.
  • No unauthorized person or service received confidential material.
  • AI or other assistance is permitted and disclosed.
  • Author and editor channels are separate.
  • Every criticism is specific, evidence-backed, proportionate, and professional.
  • No invented citation, analysis, experiment, or editorial outcome appears.
  • Deletion or authorized retention is planned.
Raw lines 224 to 235