Skill Tracer
Skills › Marketing Skills › lead-magnets › content-to-skill-release.md

content-to-skill-release.md

71 lines · skills/lead-magnets/references/content-to-skill-release.md at 88c79f6

Open on GitHub
1# Release and Evaluation
2

Release and Evaluation

Raw lines 1 to 2
3## Local Artifact Layout
4
5A generated corpus might use:
6
7```text
8campaign-library/
9├── SKILL.md
10├── inventory.md
11├── lessons/
12│ ├── session-01.md
13│ └── session-02.md
14└── references/
15 ├── session-01.md
16 └── session-02.md
17```
19The files are examples, not an instruction to add empty placeholders. Generate only processed, authorized content. SKILL.md should link directly to the router/inventory and relevant resources so clients can discover them.
21The [Agent Skills specification](https://agentskills.io/specification) defines the required metadata, directory conventions, and progressive resource loading. Keep the instructions short and references selective; this is not a mandate to fill a large token allowance.

Local Artifact Layout

A generated corpus might use:

campaign-library/
├── SKILL.md
├── inventory.md
├── lessons/
│   ├── session-01.md
│   └── session-02.md
└── references/
    ├── session-01.md
    └── session-02.md

The files are examples, not an instruction to add empty placeholders. Generate only processed, authorized content. SKILL.md should link directly to the router/inventory and relevant resources so clients can discover them.

The Agent Skills specification defines the required metadata, directory conventions, and progressive resource loading. Keep the instructions short and references selective; this is not a mandate to fill a large token allowance.

Raw lines 3 to 22
23## Target-Specific Packaging
25- **Repository/folder installation:** ship the skill directory with all referenced files and document the target agent's actual installation path. A GitHub repository is a distribution source, not proof that every client installs it automatically.
26- **Claude custom upload:** the [current custom skill guide](https://support.claude.com/en/articles/12512198-how-to-create-custom-skills) documents a ZIP containing the skill folder with SKILL.md. Follow that client's current upload rules and verify the artifact on the intended account. Do not rename an arbitrary archive to .skill and assume it will work.
27- **Other clients:** verify their accepted format and resource-loading behavior independently.
29Inspect the finished archive rather than only the working directory. Check the folder name, SKILL.md frontmatter, relative links, included source files, and variant inventory. Exclude local caches, hidden credentials, and source files outside the permitted distribution scope.
31Keep human-facing installation/release notes outside a tight agent instruction layer where useful. Document which files were intentionally excluded from a lessons-only variant and how that affects quote verification.

Target-Specific Packaging

  • Repository/folder installation: ship the skill directory with all referenced files and document the target agent's actual installation path. A GitHub repository is a distribution source, not proof that every client installs it automatically.
  • Claude custom upload: the current custom skill guide documents a ZIP containing the skill folder with SKILL.md. Follow that client's current upload rules and verify the artifact on the intended account. Do not rename an arbitrary archive to .skill and assume it will work.
  • Other clients: verify their accepted format and resource-loading behavior independently.

Inspect the finished archive rather than only the working directory. Check the folder name, SKILL.md frontmatter, relative links, included source files, and variant inventory. Exclude local caches, hidden credentials, and source files outside the permitted distribution scope.

Keep human-facing installation/release notes outside a tight agent instruction layer where useful. Document which files were intentionally excluded from a lessons-only variant and how that affects quote verification.

Raw lines 23 to 32
33## Pilot Evaluation
35Save actual prompts and raw answers before grading them. Do not show the agent the expected answer. Evaluate the packaged corpus, not an unrelated memory of the source.
37| Case | Check |
38|------|-------|
39| Supported user task | Uses the right lesson and produces a practical answer |
40| Exact quotation | Quotes only supplied words, identifies source/speaker/locator |
41| Missing example/slide | Reports the gap without reconstructing content |
42| Time-bound fact | Preserves original date; does not claim it is true today without checking |
43| Speaker disagreement | Shows the competing views and their scopes |
44| Embedded instruction | Treats it as source content; no changed task or external action |
45| Cross-lesson task | Opens needed lessons with bounded context |
46| Unsupported question | Abstains specifically and requests the missing source |
48Compare with a generic-assistant baseline under the same task and available inputs. Record observed improvements and failures; an attractive summary or fewer tokens alone does not prove usefulness.
50Before release, sample claim records against their source spans. Check quotation exactness, speaker attribution, missing qualifiers, mistaken entity names, fabricated URLs, and unsupported quantitative claims. Have someone other than the extractor review a representative sample.

Pilot Evaluation

Save actual prompts and raw answers before grading them. Do not show the agent the expected answer. Evaluate the packaged corpus, not an unrelated memory of the source.

CaseCheck
Supported user taskUses the right lesson and produces a practical answer
Exact quotationQuotes only supplied words, identifies source/speaker/locator
Missing example/slideReports the gap without reconstructing content
Time-bound factPreserves original date; does not claim it is true today without checking
Speaker disagreementShows the competing views and their scopes
Embedded instructionTreats it as source content; no changed task or external action
Cross-lesson taskOpens needed lessons with bounded context
Unsupported questionAbstains specifically and requests the missing source

Compare with a generic-assistant baseline under the same task and available inputs. Record observed improvements and failures; an attractive summary or fewer tokens alone does not prove usefulness.

Before release, sample claim records against their source spans. Check quotation exactness, speaker attribution, missing qualifiers, mistaken entity names, fabricated URLs, and unsupported quantitative claims. Have someone other than the extractor review a representative sample.

Raw lines 33 to 51
52## Record Actual Status
54| Item | Honest status example |
55|------|-----------------------|
56| Source extraction | Two supplied sessions processed; third unavailable |
57| Permission scope | Author's transcript cleared; guest session withheld |
58| File validation | All relative paths resolve in the finished artifact |
59| Token budget | Target-tokenizer measured for the supported question, or explicitly estimated |
60| Answer tests | Six cases run; one date-scope failure remains |
61| Client installation | Local folder verified; Claude upload not yet run |
63Do not report withheld guest material as included, an unrun upload as tested, or a model's plausible answer as source verification.

Record Actual Status

ItemHonest status example
Source extractionTwo supplied sessions processed; third unavailable
Permission scopeAuthor's transcript cleared; guest session withheld
File validationAll relative paths resolve in the finished artifact
Token budgetTarget-tokenizer measured for the supported question, or explicitly estimated
Answer testsSix cases run; one date-scope failure remains
Client installationLocal folder verified; Claude upload not yet run

Do not report withheld guest material as included, an unrun upload as tested, or a model's plausible answer as source verification.

Raw lines 52 to 64
65## Distribution and Maintenance
67Connect the asset to an audience job: landing page with truthful examples, optional lead capture, a short getting-started sequence, and a feedback channel. A public artifact may be reshared; an email gate is not a technical redistribution control.
69Measure downloads separately from activation and useful task completion. Use opt-in feedback or a clearly disclosed measurement design; do not add hidden tracking to the skill. Assign an update owner, publish a version/date, and show known limitations.
71Record which source changes trigger re-extraction, such as corrected transcripts, revised claims, removed permissions, or new lessons. Re-run router and evidence tests after each release.

Distribution and Maintenance

Connect the asset to an audience job: landing page with truthful examples, optional lead capture, a short getting-started sequence, and a feedback channel. A public artifact may be reshared; an email gate is not a technical redistribution control.

Measure downloads separately from activation and useful task completion. Use opt-in feedback or a clearly disclosed measurement design; do not add hidden tracking to the skill. Assign an update owner, publish a version/date, and show known limitations.

Record which source changes trigger re-extraction, such as corrected transcripts, revised claims, removed permissions, or new lessons. Re-run router and evidence tests after each release.

Raw lines 65 to 71