Skip to content

Language filter: correct the confidence semantics, announce the release - #106

Merged
styler merged 1 commit into
masterfrom
language-filter-release
Aug 17, 2026
Merged

Language filter: correct the confidence semantics, announce the release#106
styler merged 1 commit into
masterfrom
language-filter-release

Conversation

@styler

@styler styler commented Aug 17, 2026

Copy link
Copy Markdown
Member

The Language filter page described behaviour that no longer exists, and the filter has only now become reachable for creators, so it also gets a changelog entry.

The correction

The page said a message is flagged "when the detection isn't confident enough to tell", and described Minimum percentage as the bar below which messages get flagged. StreamElements/chatbot#716 flipped that: a low-confidence reading is now skipped, and the setting is the confidence the detector must reach before the filter may act.

That matters because confidence spreads across 75 languages, so short messages misdetect badly. Under the old reading, an English-only channel timed out anyone typing ok (Zulu, 6.4%) or gg (Indonesian, 14.4%), at any threshold.

What else changed on the page

  • Setting names now match the dashboard: Minimum detection confidence and Ignored words, not "Minimum percentage" and "Excluded characters". The default of 40 is documented.
  • Added a step-by-step "How a message is checked", covering the parts that were invisible before: ignored words are stripped case-insensitively, non-letters are dropped before detection, and a detector failure or timeout skips the filter rather than punishing.
  • Added the measured confidence table from the chatbot PR, so a creator tuning the value can see where real sentences (~45% and up) sit against chat noise (below 25%), and why 40 is the default.

Changelog

New entry at changelog/chatbot/2026-08-17-language-filter.mdx announcing the filter.

Verified against bot/filters/language.go at chatbot v2.31.0 and the minPercentage default in caipirinha's botFilters model. Dashboard side is StreamElements/frontend#682.

pnpm build clean, all internal links valid.

The page described the old behaviour, where a detection the bot could not
make confidently counted as a violation. That has been flipped: a
low-confidence reading is now skipped, and Minimum detection confidence is
the bar the detector must clear before the filter may act. Default is 40.

Adds how a message is checked, step by step, and the measured confidence
values behind the default, so picking a value is not guesswork. Setting
names now match the dashboard: Minimum detection confidence and Ignored
words, not Minimum percentage and Excluded characters.

Also adds a changelog entry, since the filter has only now become reachable
for creators.
@cloudflare-workers-and-pages

Copy link
Copy Markdown

Deploying with  Cloudflare Workers  Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status Name Latest Commit Updated (UTC)
✅ Deployment successful!
View logs
docs 688567a Aug 17 2026, 10:03 AM

@styler
styler merged commit ea9675f into master Aug 17, 2026
2 checks passed
@styler
styler deleted the language-filter-release branch August 17, 2026 10:04
@linear-code

linear-code Bot commented Aug 17, 2026

Copy link
Copy Markdown

CORE-597

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant