Skill Tracer
Skills › Scientific Agent Skills › hypothesis-generation › causal_inference_and_claims.md

causal_inference_and_claims.md

190 lines · skills/hypothesis-generation/references/causal_inference_and_claims.md at 5f2bc03

Open on GitHub

Most marks come from matching words in the file, so treat them as pointers.

1# Causal Inference and Claim Discipline
2

Causal Inference and Claim Discipline

Raw lines 1 to 2
3## Start with the scientific target
4
5Association, prediction, intervention effects, and mechanisms answer different questions:
6
7- **Descriptive:** What is the distribution or pattern?
8- **Associational:** How do measured variables co-vary in the observed data?
9- **Predictive:** How well does information predict outcomes in a target setting?
10- **Causal:** What would differ under specified interventions or exposure conditions?
11- **Mechanistic:** Through which process would the causal change occur?
13A model can predict accurately without identifying a causal effect. A randomized effect estimate can identify an intervention contrast without establishing the complete mechanism.

Start with the scientific target

Association, prediction, intervention effects, and mechanisms answer different questions:

  • Descriptive: What is the distribution or pattern?
  • Associational: How do measured variables co-vary in the observed data?
  • Predictive: How well does information predict outcomes in a target setting?
  • Causal: What would differ under specified interventions or exposure conditions?
  • Mechanistic: Through which process would the causal change occur?

A model can predict accurately without identifying a causal effect. A randomized effect estimate can identify an intervention contrast without establishing the complete mechanism.

Raw lines 3 to 14
15## Define a causal estimand
17Following the causal-question and ICH E9(R1) principles where applicable, specify:
191. **Population/system:** To whom or what does the contrast apply?
202. **Intervention/exposure:** What condition is set, assigned, or contrasted?
213. **Comparator:** What alternative condition is compared?
224. **Outcome:** What variable is affected and how is it measured?
235. **Time horizon:** When is the outcome assessed?
246. **Population summary:** Mean difference, risk ratio, quantile contrast, survival summary, or another target.
257. **Intercurrent events:** How are post-assignment events handled when they affect interpretation or measurement?
268. **Treatment versions:** Are interventions sufficiently well defined?
28The estimand should exist before choosing an estimator or model.

Define a causal estimand

Following the causal-question and ICH E9(R1) principles where applicable, specify:

  1. Population/system: To whom or what does the contrast apply?
  2. Intervention/exposure: What condition is set, assigned, or contrasted?
  3. Comparator: What alternative condition is compared?
  4. Outcome: What variable is affected and how is it measured?
  5. Time horizon: When is the outcome assessed?
  6. Population summary: Mean difference, risk ratio, quantile contrast, survival summary, or another target.
  7. Intercurrent events: How are post-assignment events handled when they affect interpretation or measurement?
  8. Treatment versions: Are interventions sufficiently well defined?

The estimand should exist before choosing an estimator or model.

Raw lines 15 to 29
30## Counterfactual contrast
32Causal effects compare outcomes under different conditions for the same target units, although both conditions cannot usually be observed for one unit. Identification therefore depends on design and assumptions.
34For observational data, state:
36- target-trial analogue or other design logic;
37- consistency/well-defined intervention assumptions;
38- exchangeability/no-unmeasured-confounding assumptions;
39- positivity/overlap;
40- interference assumptions;
41- measurement and missingness assumptions;
42- model assumptions introduced by estimation.
44Do not write “controlled for confounding” as if adjustment proves exchangeability.

Counterfactual contrast

Causal effects compare outcomes under different conditions for the same target units, although both conditions cannot usually be observed for one unit. Identification therefore depends on design and assumptions.

For observational data, state:

  • target-trial analogue or other design logic;
  • consistency/well-defined intervention assumptions;
  • exchangeability/no-unmeasured-confounding assumptions;
  • positivity/overlap;
  • interference assumptions;
  • measurement and missingness assumptions;
  • model assumptions introduced by estimation.

Do not write “controlled for confounding” as if adjustment proves exchangeability.

Raw lines 30 to 45
46## Bias pathways

Bias pathways

Raw lines 46 to 47
48### Confounding
50A common cause of exposure/intervention and outcome can create or obscure an association. Address through design, randomization where ethical/feasible, restriction, matching, measurement and adjustment of justified common causes, negative controls, sensitivity analysis, or triangulation.
52Risks:
54- unmeasured or poorly measured common causes;
55- time-varying confounders affected by prior treatment;
56- inappropriate adjustment for instruments, mediators, or colliders;
57- residual confounding after coarse categorization.

Confounding

A common cause of exposure/intervention and outcome can create or obscure an association. Address through design, randomization where ethical/feasible, restriction, matching, measurement and adjustment of justified common causes, negative controls, sensitivity analysis, or triangulation.

Risks:

  • unmeasured or poorly measured common causes;
  • time-varying confounders affected by prior treatment;
  • inappropriate adjustment for instruments, mediators, or colliders;
  • residual confounding after coarse categorization.
Raw lines 48 to 58
59### Selection bias
61Selection into the sample, analysis, follow-up, or observed outcome can depend on causes of exposure and outcome. Record:
63- sampling and eligibility;
64- participation and consent;
65- exclusions;
66- attrition and censoring;
67- complete-case restrictions;
68- availability of measurements;
69- conditioning introduced by data linkage.

Selection bias

Selection into the sample, analysis, follow-up, or observed outcome can depend on causes of exposure and outcome. Record:

  • sampling and eligibility;
  • participation and consent;
  • exclusions;
  • attrition and censoring;
  • complete-case restrictions;
  • availability of measurements;
  • conditioning introduced by data linkage.
Raw lines 59 to 70
71### Collider bias
73A collider is a common effect of two variables. Conditioning on it or its descendant can open a non-causal path. Common sources include:
75- selection into a study or subgroup;
76- restricting to diagnosed, hospitalized, tested, or surviving participants;
77- adjusting for a post-exposure variable affected by another cause of the outcome;
78- using complete cases when missingness is jointly caused.
80More covariates are not automatically better.

Collider bias

A collider is a common effect of two variables. Conditioning on it or its descendant can open a non-causal path. Common sources include:

  • selection into a study or subgroup;
  • restricting to diagnosed, hospitalized, tested, or surviving participants;
  • adjusting for a post-exposure variable affected by another cause of the outcome;
  • using complete cases when missingness is jointly caused.

More covariates are not automatically better.

Raw lines 71 to 81
82### Reverse causation
84The outcome or its precursors may influence the exposure or measurement. Cross-sectional order is especially weak evidence of direction. Use temporal design, lagged measurements, incident outcomes, intervention, negative controls, or explicit bidirectional candidates where appropriate.

Reverse causation

The outcome or its precursors may influence the exposure or measurement. Cross-sectional order is especially weak evidence of direction. Use temporal design, lagged measurements, incident outcomes, intervention, negative controls, or explicit bidirectional candidates where appropriate.

Raw lines 82 to 85
86### Measurement bias
88Measurement error can:
90- attenuate or inflate estimates;
91- differ by exposure or outcome;
92- induce apparent interactions;
93- distort covariate adjustment;
94- affect selection into analysis.
96Operationalization and validation are part of causal design, not a later documentation task.

Measurement bias

Measurement error can:

  • attenuate or inflate estimates;
  • differ by exposure or outcome;
  • induce apparent interactions;
  • distort covariate adjustment;
  • affect selection into analysis.

Operationalization and validation are part of causal design, not a later documentation task.

Raw lines 86 to 97
98## Mediators and effect modifiers
100- A **mediator** lies on a causal pathway. Adjusting for it changes the target from total to a direct or controlled effect and introduces additional assumptions.
101- An **effect modifier** describes variation in a causal contrast across strata. It is not synonymous with statistical interaction in every scale.
102- A **confounder** is defined relative to a target causal contrast and design, not simply by association with the outcome.
104Label the intended role before analysis and justify it with domain knowledge and a causal structure.

Mediators and effect modifiers

  • A mediator lies on a causal pathway. Adjusting for it changes the target from total to a direct or controlled effect and introduces additional assumptions.
  • An effect modifier describes variation in a causal contrast across strata. It is not synonymous with statistical interaction in every scale.
  • A confounder is defined relative to a target causal contrast and design, not simply by association with the outcome.

Label the intended role before analysis and justify it with domain knowledge and a causal structure.

Raw lines 98 to 105
106## Negative controls
108Lipsitch, Tchetgen Tchetgen, and Cohen distinguish negative-control exposures and outcomes:
110- A negative-control exposure should not cause the target outcome but should share relevant confounding/bias pathways.
111- A negative-control outcome should not be caused by the target exposure but should share relevant bias pathways. Excluding only the proposed mechanism is insufficient if another causal pathway from exposure to control outcome remains.
113Specify:
115- why the target mechanism cannot operate;
116- which biases should be shared;
117- expected result;
118- implication of control failure;
119- alternative reasons for a non-null control result.
121Negative controls detect some biases under assumptions; they do not prove absence of bias. A non-null control can reflect a violated exclusion or shared-bias assumption, and its effect size does not generally quantify bias in the target estimate.

Negative controls

Lipsitch, Tchetgen Tchetgen, and Cohen distinguish negative-control exposures and outcomes:

  • A negative-control exposure should not cause the target outcome but should share relevant confounding/bias pathways.
  • A negative-control outcome should not be caused by the target exposure but should share relevant bias pathways. Excluding only the proposed mechanism is insufficient if another causal pathway from exposure to control outcome remains.

Specify:

  • why the target mechanism cannot operate;
  • which biases should be shared;
  • expected result;
  • implication of control failure;
  • alternative reasons for a non-null control result.

Negative controls detect some biases under assumptions; they do not prove absence of bias. A non-null control can reflect a violated exclusion or shared-bias assumption, and its effect size does not generally quantify bias in the target estimate.

Raw lines 106 to 122
123## Claim-language rules

Claim-language rules

Raw lines 123 to 124
125### Associational
127Use:
129- “was associated with”;
130- “co-varied with”;
131- “predicted in the evaluated dataset”;
132- “the adjusted association.”
134State design, population, timing, effect/summary measure, uncertainty, and limitations.

Associational

Use:

  • “was associated with”;
  • “co-varied with”;
  • “predicted in the evaluated dataset”;
  • “the adjusted association.”

State design, population, timing, effect/summary measure, uncertainty, and limitations.

Raw lines 125 to 135
136### Causal
138Use causal verbs only when:
140- the causal estimand is explicit;
141- design/identification logic is stated;
142- assumptions and sensitivity are visible;
143- confounding, selection, collider, reverse-causation, and measurement risks are addressed;
144- language is calibrated to the evidence.
146For observational work, “estimated causal effect under the stated assumptions” is often more accurate than an unqualified causal declaration.

Causal

Use causal verbs only when:

  • the causal estimand is explicit;
  • design/identification logic is stated;
  • assumptions and sensitivity are visible;
  • confounding, selection, collider, reverse-causation, and measurement risks are addressed;
  • language is calibrated to the evidence.

For observational work, “estimated causal effect under the stated assumptions” is often more accurate than an unqualified causal declaration.

Raw lines 136 to 147
148### Mechanistic
150Distinguish:
152- direct evidence for process steps;
153- mediation or intermediate measurements;
154- perturbation/rescue evidence;
155- temporal ordering;
156- analogy or plausibility only.
158A causal intervention effect does not by itself verify the proposed pathway.

Mechanistic

Distinguish:

  • direct evidence for process steps;
  • mediation or intermediate measurements;
  • perturbation/rescue evidence;
  • temporal ordering;
  • analogy or plausibility only.

A causal intervention effect does not by itself verify the proposed pathway.

Raw lines 148 to 159
160## Markdown claim annotations
162The bundled linter recognizes line-level annotations:
164```markdown
165[claim:associational] Exposure X was associated with outcome Y in the observed cohort.
167[claim:causal][estimand:E1][identification:observational_assumption_dependent][confounding:unresolved][selection:assessed][collider:assessed][reverse-causation:assessed] Under the stated assumptions, intervention X would reduce outcome Y over 12 months.
168```
170Allowed risk states are `assessed`, `unresolved`, and `not_applicable`. “Assessed” records that a human evaluation exists; it does not mean the risk is absent.
172Run:
174```bash
175python3 scripts/lint_causal_claims.py local-draft.md
176```
178The linter is lexical. It can miss causal language, flag benign phrases, and cannot judge whether a design identifies an effect.

Markdown claim annotations

The bundled linter recognizes line-level annotations:

[claim:associational] Exposure X was associated with outcome Y in the observed cohort.

[claim:causal][estimand:E1][identification:observational_assumption_dependent][confounding:unresolved][selection:assessed][collider:assessed][reverse-causation:assessed] Under the stated assumptions, intervention X would reduce outcome Y over 12 months.

Allowed risk states are assessed, unresolved, and not_applicable. “Assessed” records that a human evaluation exists; it does not mean the risk is absent.

Run:

python3 scripts/lint_causal_claims.py local-draft.md

The linter is lexical. It can miss causal language, flag benign phrases, and cannot judge whether a design identifies an effect.

Raw lines 160 to 179
Runs code python3 scripts/lint_causal_claims.py :175
180## Intervention-trial context
182For intervention hypotheses:
184- align objectives, estimands, outcomes, timing, harms, and analysis;
185- use SPIRIT 2025 for protocol reporting and CONSORT 2025 for trial-result reporting;
186- preserve access to protocol and statistical analysis plan;
187- report important post-start changes and non-prespecified outcomes/analyses;
188- include harms and participant/public involvement where applicable.
190Reporting completeness is not proof of ethical approval, design validity, regulatory compliance, or treatment efficacy.

Intervention-trial context

For intervention hypotheses:

  • align objectives, estimands, outcomes, timing, harms, and analysis;
  • use SPIRIT 2025 for protocol reporting and CONSORT 2025 for trial-result reporting;
  • preserve access to protocol and statistical analysis plan;
  • report important post-start changes and non-prespecified outcomes/analyses;
  • include harms and participant/public involvement where applicable.

Reporting completeness is not proof of ethical approval, design validity, regulatory compliance, or treatment efficacy.

Raw lines 180 to 190