About CassianBot

CassianBot is the automated web crawler operated by Cassian™ to monitor and analyse online stores on behalf of our customers. It powers features such as uptime monitoring, sitemap tracking, link checking, and domain health inspections.

CassianBot only visits stores that have been explicitly added to the Cassian platform by their owners or authorised managers. It does not perform unsolicited crawling.

When CassianBot makes direct HTTP requests (uptime checks, sitemap fetches, link validation), it identifies itself with the following User-Agent:

Some Cassian features use managed crawling infrastructure (Scrapfly) for full-page rendering and screenshot capture. These requests use the crawling provider's own User-Agent and are not identified as CassianBot. See our Subprocessors page for details.

CassianBot performs the following types of requests:

CassianBot is designed to be lightweight and respectful:

• Uptime checks use HTTP HEAD requests (no page body downloaded)
• Link validation is rate-limited to avoid overloading target servers
• Sitemap fetches download only the sitemap XML, not the pages listed within it
• CassianBot does not execute JavaScript, submit forms, or interact with page elements
• All requests use standard HTTP timeouts and do not retry aggressively

If you see CassianBot visiting your site and you are not a Cassian customer, it is likely because the store owner or an authorised manager added your store to their Cassian account. You can block CassianBot by adding the following to your robots.txt file:

CassianBot respects robots.txt directives. If you block CassianBot, monitoring features (uptime, sitemap, links) will not function for that store within Cassian.

Alternatively, you can contact the store owner or manager who added your site and ask them to remove it from their Cassian account.

CassianBot collects only publicly accessible data. It does not access password-protected pages, admin panels, or private API endpoints. Data collected by CassianBot is processed in accordance with our Privacy Policy and Data Processing Agreement.

If you have questions or concerns about CassianBot visiting your site, contact us at:

Cassian — Technical Team
New Zealand
Email: support@getcassian.com