Skip to content

Add factual-reliability tell and broaden the dash rule#166

Open
karotkriss wants to merge 2 commits into
blader:mainfrom
karotkriss:factual-reliability-and-dash-rule
Open

Add factual-reliability tell and broaden the dash rule#166
karotkriss wants to merge 2 commits into
blader:mainfrom
karotkriss:factual-reliability-and-dash-rule

Conversation

@karotkriss

Copy link
Copy Markdown

What this does

Adds one well-sourced AI tell, sharpens two existing ones, and broadens the dash rule. Each addition is backed by a real, citable source (listed at the bottom).

Factual reliability (new section 34)

Adds a "Factual Reliability" group with a new pattern, Fabricated and unverifiable citations. Invented but plausible references are among the most consequential documented failure modes of LLM writing, and the skill did not cover them. The pattern tells the editor to confirm a source exists and supports the claim, then keep it, or cut the claim.

Dashes as punctuation (section 14, broadened)

The rule now targets the dash look as punctuation rather than one glyph: em dash, en dash, and the spaced hyphen standing in for one. Swapping an em dash for a spaced hyphen relocates the tell instead of removing it. The section adds a rephrase ladder (period, semicolon, comma, parentheses, colon) and explicitly protects real word hyphens (well-known, names, URLs, identifiers).

Section 7 (AI vocabulary)

Replaces an unsourced "appears more in post-2023 text" assertion with grounding in the Kobak et al. excess-vocabulary study, which measured this register surging across 15 million PubMed abstracts.

Section 20 (chatbot artifacts)

Adds the leaked-assistant phrase family ("As an AI language model...", "as a large language model", "I'm sorry, but I cannot").

Consistency fix

The skill's own instructional prose still had three em dashes in it, which is a bad look for a skill about killing dashes. This may influence the AI as well: a skill that models the very pattern it is asking the model to remove can reinforce it. Those three are rephrased out. The only dash glyphs left in the file are intentional, either naming the character in the rule or sitting inside the deliberately bad "before" examples.

Also syncs the README pattern index from 33 to 34.

References

- Section 14: target the dash look as punctuation (em dash, en dash, and the
  spaced hyphen standing in for one) rather than a single glyph, with a rephrase
  ladder and style-authority sourcing. Word hyphens stay.
- New Factual Reliability section with section 34 (fabricated and unverifiable
  citations), a documented and high-stakes failure mode the skill did not cover.
- Section 7: ground the AI-vocabulary claim in the Kobak excess-vocabulary study.
- Section 20: add the leaked-assistant phrase family ("As an AI language model").
- Remove three em dashes from the skill's own instructional prose.
- Sync the README pattern index from 33 to 34.
Follows the AGENTS.md maintenance contract: a content change bumps the
SKILL.md frontmatter version and adds a matching README version-history note.
@karotkriss

Copy link
Copy Markdown
Author

@blader I made some tweaks I think are useful based on some of my university research and private works.
Let me know if you have any questions or if anything doesn't align with you want for this project, I notice you don't have a contribution doc for guidelines so just checking with you first.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant