KnositeBot

KnositeBot reads web pages for Knosite customers so their assistant can answer questions about their own site. It only reads sites that their owner has added to Knosite.

How it behaves

It follows your robots.txt (user agent KnositeBot, then *) and skips pages marked noindex. It re-reads pages on a schedule and does not crawl faster than your server allows.

Block it

Add this to your robots.txt:

User-agent: KnositeBot
Disallow: /

Questions? Email hello@knosite.fyi.