Skip to content

Add Botstopper pre-policy examples page - #540

Open
hnyasingunaydin wants to merge 2 commits into
ByteInternet:masterfrom
hnyasingunaydin:botstopper-pre-policy-examples
Open

hnyasingunaydin wants to merge 2 commits into
ByteInternet:masterfrom
hnyasingunaydin:botstopper-pre-policy-examples

Conversation

@hnyasingunaydin

@hnyasingunaydin hnyasingunaydin commented Nov 6, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Adds a new page Pre-Policy Examples for Botstopper under Hypernode platform → Botstopper, with ready-to-use rules for /data/web/botstopper/pre.policy.yml.

The examples come from the Botstopper policy snippets repository and are grouped as:

  • Search engines and SEO tools: Google crawlers, Ahrefs, Semrush Site Audit
  • AI retrieval bots: Perplexity, OpenAI, and Claude bots
  • Uptime monitoring: HetrixTools, Oh Dear, Pingdom, UptimeRobot, Uptime Kuma
  • Cookie consent scanners: Cookiebot, CookieYes
  • WordPress tools: BlogVault, InfiniteWP, WP Rocket
  • Other integrations: Sendcloud, SleakBot
  • Country-based rules: allow Benelux, deny outside EU/UK/US

Each rule has a short explanation and a link to the vendor's published IP list. Rules that only match on user agent, and the broad country rules, have a note or warning.

Changes

  • New page: docs/hypernode-platform/botstopper/pre-policy-examples-for-botstopper.md
  • Rules with more than 10 IP addresses are collapsed in a <details> element ("Show the full rule (N IP addresses)") to keep the page readable. The copy button still copies the full rule.
  • Added a bottom margin and pointer cursor for details in _code.scss and main.css.

Add a page under Botstopper with ready-to-use pre.policy.yml rules for
search engines, SEO tools, AI retrieval bots, uptime monitoring, cookie
consent scanners, WordPress tools, integrations and country-based rules.

Long IP address lists are collapsed in a details element, with a small
margin added in the stylesheet.

Co-authored-by: yasingunaydiin <81875281+yasingunaydiin@users.noreply.github.com>
@hnyasingunaydin
hnyasingunaydin force-pushed the botstopper-pre-policy-examples branch from ea88a90 to a3be63a Compare November 7, 2026 11:46
@poespas

poespas commented Nov 9, 2026

Copy link
Copy Markdown
Collaborator

I would discourage using IP ranges in the documentation as this might become outdated very quickly.

font-size: 14px;
}

.rst-content details {

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this really required?

html_meta:
description: Ready-to-use Botstopper pre-policy examples for Hypernode, to allow
trusted bots, monitoring tools, and integrations before the standard rules run.
title: Pre-Policy Examples for Botstopper | Hypernode

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
title: Pre-Policy Examples for Botstopper | Hypernode
title: Pre-Policy Examples for Botstopper

IP ranges in the docs go out of date quickly. Replace the IP lists with
a placeholder and point to the IP lists that each provider publishes.
Remove the collapsibles and their styles, which are no longer needed.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

3 participants