Skill Tracer
Skills › Scientific Agent Skills › hypothesis-generation › ethics_safety_and_ai.md

ethics_safety_and_ai.md

216 lines · skills/hypothesis-generation/references/ethics_safety_and_ai.md at 5f2bc03

Open on GitHub
1# Ethics, Safety, Feasibility, and Responsible AI
2

Ethics, Safety, Feasibility, and Responsible AI

Raw lines 1 to 2
3## This is a routing guide
4
5This reference helps identify gates. It is not legal, medical, regulatory, biosafety, biosecurity, export-control, ethics, or institutional advice. Requirements vary by jurisdiction, sponsor, institution, organism, material, and intended use.
6
7When applicability is uncertain, mark the gate `undetermined`, stop operational planning, and obtain a determination from the qualified local authority.
8

This is a routing guide

This reference helps identify gates. It is not legal, medical, regulatory, biosafety, biosecurity, export-control, ethics, or institutional advice. Requirements vary by jurisdiction, sponsor, institution, organism, material, and intended use.

When applicability is uncertain, mark the gate undetermined, stop operational planning, and obtain a determination from the qualified local authority.

Raw lines 3 to 8
9## Universal intake
11Record:
13- accountable owner and institution;
14- intended purpose and foreseeable misuse;
15- affected people, animals, communities, ecosystems, infrastructure, or security interests;
16- data and material sensitivity;
17- funding, jurisdiction, and collaborating sites;
18- required expertise;
19- conflicts and incentives;
20- approvals, determinations, and unresolved blocks;
21- less risky ways to answer the question.
23Feasibility never overrides ethics or safety.

Universal intake

Record:

  • accountable owner and institution;
  • intended purpose and foreseeable misuse;
  • affected people, animals, communities, ecosystems, infrastructure, or security interests;
  • data and material sensitivity;
  • funding, jurisdiction, and collaborating sites;
  • required expertise;
  • conflicts and incentives;
  • approvals, determinations, and unresolved blocks;
  • less risky ways to answer the question.

Feasibility never overrides ethics or safety.

Raw lines 9 to 24
25## Human-participant gate
27Potential triggers include:
29- intervention or interaction with living people;
30- identifiable private information or biospecimens;
31- secondary use, linkage, re-identification, recruitment, or contact;
32- vulnerable populations or sensitive topics;
33- international or community-governed data.
35Required action:
37- obtain an IRB/REC or other authorized determination before research starts;
38- do not self-declare exemption;
39- address consent or authorized waiver, privacy, security, equitable selection, risk/benefit, compensation, return of results, and community governance as applicable;
40- use additional protections required by law or policy.
42In the United States, HHS 45 CFR 46 includes the Common Rule and additional subparts. Local and non-U.S. rules can differ. The 2024 revision of the World Medical Association Declaration of Helsinki is a relevant international ethical statement for medical research involving human participants.
44This skill does not provide clinical advice or authorize an intervention.

Human-participant gate

Potential triggers include:

  • intervention or interaction with living people;
  • identifiable private information or biospecimens;
  • secondary use, linkage, re-identification, recruitment, or contact;
  • vulnerable populations or sensitive topics;
  • international or community-governed data.

Required action:

  • obtain an IRB/REC or other authorized determination before research starts;
  • do not self-declare exemption;
  • address consent or authorized waiver, privacy, security, equitable selection, risk/benefit, compensation, return of results, and community governance as applicable;
  • use additional protections required by law or policy.

In the United States, HHS 45 CFR 46 includes the Common Rule and additional subparts. Local and non-U.S. rules can differ. The 2024 revision of the World Medical Association Declaration of Helsinki is a relevant international ethical statement for medical research involving human participants.

This skill does not provide clinical advice or authorize an intervention.

Raw lines 25 to 45
46## Animal-research gate
48Potential triggers include live vertebrate animals, field capture, breeding, procedures, tissues tied to ongoing animal activities, or covered training/testing.
50Required action:
52- obtain the applicable IACUC or equivalent approval before work;
53- establish institutional assurance and veterinary oversight where required;
54- apply replacement, reduction, and refinement;
55- justify species/model, numbers, endpoints, welfare monitoring, analgesia/anesthesia, and humane endpoints through the authorized process;
56- use current reporting guidance such as ARRIVE when applicable.
58The bundled tools do not calculate animal numbers or approve protocols.

Animal-research gate

Potential triggers include live vertebrate animals, field capture, breeding, procedures, tissues tied to ongoing animal activities, or covered training/testing.

Required action:

  • obtain the applicable IACUC or equivalent approval before work;
  • establish institutional assurance and veterinary oversight where required;
  • apply replacement, reduction, and refinement;
  • justify species/model, numbers, endpoints, welfare monitoring, analgesia/anesthesia, and humane endpoints through the authorized process;
  • use current reporting guidance such as ARRIVE when applicable.

The bundled tools do not calculate animal numbers or approve protocols.

Raw lines 46 to 59
60## Biosafety and biosecurity gate
62Potential triggers include:
64- recombinant or synthetic nucleic acids;
65- infectious agents, toxins, biological materials, gene transfer, or modified organisms;
66- environmental release;
67- select agents or regulated materials;
68- procedures that could alter hazard, host range, pathogenicity, transmissibility, resistance, or detection;
69- work beyond established institutional containment and training.
71Required action:
73- stop before operational detail;
74- route to the biosafety officer, Institutional Biosafety Committee, and other required authority;
75- use the current NIH Guidelines, CDC/NIH *Biosafety in Microbiological and Biomedical Laboratories*, local biosafety manual, and applicable regulations;
76- document containment and occupational-health decisions only after authorized review.
78Do not infer a containment level or operating procedure from this skill.

Biosafety and biosecurity gate

Potential triggers include:

  • recombinant or synthetic nucleic acids;
  • infectious agents, toxins, biological materials, gene transfer, or modified organisms;
  • environmental release;
  • select agents or regulated materials;
  • procedures that could alter hazard, host range, pathogenicity, transmissibility, resistance, or detection;
  • work beyond established institutional containment and training.

Required action:

  • stop before operational detail;
  • route to the biosafety officer, Institutional Biosafety Committee, and other required authority;
  • use the current NIH Guidelines, CDC/NIH Biosafety in Microbiological and Biomedical Laboratories, local biosafety manual, and applicable regulations;
  • document containment and occupational-health decisions only after authorized review.

Do not infer a containment level or operating procedure from this skill.

Raw lines 60 to 79
80## Dual-use and harmful-use gate
82Potential triggers include research, data, models, or protocols that could reasonably enable:
84- increased biological harm or spread;
85- evasion of detection, treatment, control, or safeguards;
86- scalable production or dissemination of harmful agents;
87- weaponization;
88- exploitation of critical vulnerabilities;
89- transfer of restricted technical information.
91Required action:
931. Do not provide optimization, stepwise procedures, parameter choices, sequences, acquisition pathways, or troubleshooting that increase harmful capability.
942. Preserve only a high-level scientific question, benefit rationale, and risk statement.
953. Route to institutional dual-use/biosecurity review, funder, legal/export-control, and other required authorities.
964. Follow current policy, award terms, and jurisdiction-specific controls.

Dual-use and harmful-use gate

Potential triggers include research, data, models, or protocols that could reasonably enable:

  • increased biological harm or spread;
  • evasion of detection, treatment, control, or safeguards;
  • scalable production or dissemination of harmful agents;
  • weaponization;
  • exploitation of critical vulnerabilities;
  • transfer of restricted technical information.

Required action:

  1. Do not provide optimization, stepwise procedures, parameter choices, sequences, acquisition pathways, or troubleshooting that increase harmful capability.
  2. Preserve only a high-level scientific question, benefit rationale, and risk statement.
  3. Route to institutional dual-use/biosecurity review, funder, legal/export-control, and other required authorities.
  4. Follow current policy, award terms, and jurisdiction-specific controls.
Raw lines 80 to 97
98### U.S. policy status checked 2026-10-01
100- The July 2026 [USG Policy for Stopping High-Risk Life Sciences Research](https://www.whitehouse.gov/wp-content/uploads/2026/07/USG-Policy-for-Stopping-High-Risk-Life-Sciences-Research_July-2026.pdf) has been issued; it is no longer an awaited replacement for the 2024 DURC/PEPP framework.
101- NIH [NOT-OD-26-101](https://grants.nih.gov/grants/guide/notice-files/NOT-OD-26-101.html), issued July 28, 2026, describes federal funding prohibitions and oversight for dangerous gain-of-function research and international research of concern. It states that activities previously identified as potential dangerous gain-of-function research remain paused until NIH-specific implementation requirements are established. Do not infer that policy publication authorizes resumption.
102- The [NIH biosafety/biosecurity portal](https://osp.od.nih.gov/policies/biosafety-and-biosecurity-policy/) still directs researchers to the April 2024 NIH Guidelines. Its separately proposed [Draft NIH Biosafety Policy](https://grants.nih.gov/grants/guide/notice-files/NOT-OD-26-112.html), released August 19 with comments due October 19, 2026, would replace those Guidelines only when finalized. The draft is not an effective replacement.
104Check the current agency implementation notices, award terms, and institutional determination for every project; neither a historical policy nor a pending proposal is clearance.
106WHO’s *Global Guidance Framework for the Responsible Use of the Life Sciences* provides an international risk-governance framework; it does not replace national or local rules.

U.S. policy status checked 2026-10-01

  • The July 2026 USG Policy for Stopping High-Risk Life Sciences Research has been issued; it is no longer an awaited replacement for the 2024 DURC/PEPP framework.
  • NIH NOT-OD-26-101, issued July 28, 2026, describes federal funding prohibitions and oversight for dangerous gain-of-function research and international research of concern. It states that activities previously identified as potential dangerous gain-of-function research remain paused until NIH-specific implementation requirements are established. Do not infer that policy publication authorizes resumption.
  • The NIH biosafety/biosecurity portal still directs researchers to the April 2024 NIH Guidelines. Its separately proposed Draft NIH Biosafety Policy, released August 19 with comments due October 19, 2026, would replace those Guidelines only when finalized. The draft is not an effective replacement.

Check the current agency implementation notices, award terms, and institutional determination for every project; neither a historical policy nor a pending proposal is clearance.

WHO’s Global Guidance Framework for the Responsible Use of the Life Sciences provides an international risk-governance framework; it does not replace national or local rules.

Raw lines 98 to 107
108## Data-governance gate
110Before using data:
112- confirm authority, consent, license, data-use agreement, and purpose limitation;
113- classify sensitivity and re-identification risk;
114- minimize fields and access;
115- use approved storage, retention, deletion, audit, and sharing controls;
116- address community and Indigenous governance;
117- separate public, controlled, confidential, proprietary, and export-controlled materials.
119Passing a local schema check is not de-identification, anonymization, HIPAA compliance, GDPR compliance, or authorization to share.

Data-governance gate

Before using data:

  • confirm authority, consent, license, data-use agreement, and purpose limitation;
  • classify sensitivity and re-identification risk;
  • minimize fields and access;
  • use approved storage, retention, deletion, audit, and sharing controls;
  • address community and Indigenous governance;
  • separate public, controlled, confidential, proprietary, and export-controlled materials.

Passing a local schema check is not de-identification, anonymization, HIPAA compliance, GDPR compliance, or authorization to share.

Raw lines 108 to 120
121## Regulatory gate
123Potential triggers include:
125- human interventions or clinical investigations;
126- drugs, biologics, devices, diagnostics, or software intended for clinical use;
127- environmental release;
128- genetically modified organisms;
129- regulated laboratory, animal, agricultural, or chemical activities;
130- claims intended for product labeling, approval, or public-health action.
132Record:
134- intended use;
135- jurisdiction;
136- product/activity classification;
137- sponsor and responsible regulatory owner;
138- applicable quality system or submission route;
139- current determination and source/date.
141Do not infer regulatory status from a research label, reporting checklist, or generated artifact.

Regulatory gate

Potential triggers include:

  • human interventions or clinical investigations;
  • drugs, biologics, devices, diagnostics, or software intended for clinical use;
  • environmental release;
  • genetically modified organisms;
  • regulated laboratory, animal, agricultural, or chemical activities;
  • claims intended for product labeling, approval, or public-health action.

Record:

  • intended use;
  • jurisdiction;
  • product/activity classification;
  • sponsor and responsible regulatory owner;
  • applicable quality system or submission route;
  • current determination and source/date.

Do not infer regulatory status from a research label, reporting checklist, or generated artifact.

Raw lines 121 to 142
143## Feasibility gate
145Assess:
147- scientific and technical capability;
148- validated measurement;
149- statistical information/precision;
150- qualified personnel and facilities;
151- time and resources;
152- access to population/system;
153- approvals and material/data access;
154- foreseeable failure and stopping criteria.
156If infeasible, revise the question or conduct a bounded feasibility study. Do not weaken protections or invent optimistic assumptions.

Feasibility gate

Assess:

  • scientific and technical capability;
  • validated measurement;
  • statistical information/precision;
  • qualified personnel and facilities;
  • time and resources;
  • access to population/system;
  • approvals and material/data access;
  • foreseeable failure and stopping criteria.

If infeasible, revise the question or conduct a bounded feasibility study. Do not weaken protections or invent optimistic assumptions.

Raw lines 143 to 157
158## Responsible AI policy

Responsible AI policy

Raw lines 158 to 159
160### Local-first rule
162Default to local processing. Do not send sensitive, unpublished, confidential, personal, proprietary, controlled, or security-relevant information to an external AI system without:
164- explicit authorization;
165- a named approved service and account;
166- a defined minimum data scope;
167- contract, retention, training-use, location, and access review;
168- applicable publisher, funder, institutional, and participant permission.
170The bundled scripts make no network, model, image, or external-service calls and read no environment credentials.

Local-first rule

Default to local processing. Do not send sensitive, unpublished, confidential, personal, proprietary, controlled, or security-relevant information to an external AI system without:

  • explicit authorization;
  • a named approved service and account;
  • a defined minimum data scope;
  • contract, retention, training-use, location, and access review;
  • applicable publisher, funder, institutional, and participant permission.

The bundled scripts make no network, model, image, or external-service calls and read no environment credentials.

Raw lines 160 to 171
172### Human accountability
174An accountable human must:
176- own the question, candidate set, and final scientific decisions;
177- verify every citation, identifier, quotation, and source-to-claim link;
178- verify calculations and scientific plausibility;
179- inspect omitted rivals and boundary conditions;
180- review ethics, safety, privacy, dual-use, and regulatory implications;
181- disclose AI assistance where policy requires;
182- retain or delete records under the controlling policy.
184AI output is not evidence and cannot grant approval.

Human accountability

An accountable human must:

  • own the question, candidate set, and final scientific decisions;
  • verify every citation, identifier, quotation, and source-to-claim link;
  • verify calculations and scientific plausibility;
  • inspect omitted rivals and boundary conditions;
  • review ethics, safety, privacy, dual-use, and regulatory implications;
  • disclose AI assistance where policy requires;
  • retain or delete records under the controlling policy.

AI output is not evidence and cannot grant approval.

Raw lines 172 to 185
186### Known AI risks
188NIST AI 600-1 identifies generative-AI risks including confabulation, data privacy, harmful bias/homogenization, information integrity, human–AI configuration, and dangerous recommendations. Mitigate by:
190- independent human ideation before AI expansion;
191- generating rivals from different disciplinary perspectives;
192- separating source retrieval from claim synthesis;
193- checking primary sources directly;
194- recording prompts/tool versions when authorized and scientifically relevant;
195- challenging convergent, polished, or overly confident output;
196- using multiple human reviewers for high-consequence work.
198Doshi and Hauser’s 2024 experiment found AI-assisted stories were more similar to one another even while some individual creativity measures improved. Do not generalize that one study to all scientific ideation; treat homogenization as a plausible risk and preserve independent candidate generation.
200UNESCO’s AI ethics recommendation emphasizes human rights, privacy/data protection, responsibility/accountability, transparency, and human oversight. Ultimate responsibility remains human.

Known AI risks

NIST AI 600-1 identifies generative-AI risks including confabulation, data privacy, harmful bias/homogenization, information integrity, human–AI configuration, and dangerous recommendations. Mitigate by:

  • independent human ideation before AI expansion;
  • generating rivals from different disciplinary perspectives;
  • separating source retrieval from claim synthesis;
  • checking primary sources directly;
  • recording prompts/tool versions when authorized and scientifically relevant;
  • challenging convergent, polished, or overly confident output;
  • using multiple human reviewers for high-consequence work.

Doshi and Hauser’s 2024 experiment found AI-assisted stories were more similar to one another even while some individual creativity measures improved. Do not generalize that one study to all scientific ideation; treat homogenization as a plausible risk and preserve independent candidate generation.

UNESCO’s AI ethics recommendation emphasizes human rights, privacy/data protection, responsibility/accountability, transparency, and human oversight. Ultimate responsibility remains human.

Raw lines 186 to 201
202## Stop conditions
204Stop and escalate when:
206- authorization is absent or ambiguous;
207- a required review is missing;
208- data or material classification is unknown;
209- harmful-use potential cannot be bounded;
210- a request seeks operational harmful detail;
211- patient-specific advice is requested;
212- a regulatory or legal determination is needed;
213- the proposed measurement cannot validly bear on the construct;
214- qualified expertise is unavailable.
216Record the block without copying sensitive details into a general-purpose artifact.

Stop conditions

Stop and escalate when:

  • authorization is absent or ambiguous;
  • a required review is missing;
  • data or material classification is unknown;
  • harmful-use potential cannot be bounded;
  • a request seeks operational harmful detail;
  • patient-specific advice is requested;
  • a regulatory or legal determination is needed;
  • the proposed measurement cannot validly bear on the construct;
  • qualified expertise is unavailable.

Record the block without copying sensitive details into a general-purpose artifact.

Raw lines 202 to 216