SiteAuditBot
Semrush's other crawler.
Quick answer
SiteAuditBot is a crawler Semrush uses specifically for its Site Audit tool, which checks a site for on-page SEO, technical, and usability issues. It is a separate robots.txt token from the main SemrushBot, controlled fully on its own terms and schedule.
What it does
SiteAuditBot crawls a site on behalf of Semrush's Site Audit feature, scanning pages to flag on-page SEO problems, technical errors, and usability issues that marketers and SEO teams use to fix their own sites. Semrush documents this as a distinct token from the main SemrushBot, which serves other Semrush features, so a site owner can choose to allow or block Site Audit crawling independently of Semrush's broader crawling. SiteAuditBot respects robots.txt, following standard disallow and allow directives like other compliant SEO crawlers. There is no published IP range list for SiteAuditBot, so verifying its traffic relies on Semrush's own documentation rather than an IP check.
Facts
Operator
Semrush
Robots token
SiteAuditBot
User agent string(s)
- (see semrush.com/bot/ for current User-Agent format)
Purpose
Other
Respects robots.txt
Yes
From Semrush's documentation, checked Oct 2026.
Should you block it?
Because SiteAuditBot is a commercial SEO tool crawler rather than a bot connected to AI answers or search indexing, the real tradeoff here is crawl load and who gets to run technical audits against a site, not AI visibility. If the site's own team uses Semrush's Site Audit tool to check their own pages for SEO and technical issues, blocking SiteAuditBot would break that workflow for their own domain. If the concern is unrelated third parties, including competitors, running Site Audit scans against the site and consuming server resources in the process, disallowing SiteAuditBot limits that without affecting the main SemrushBot or any other crawler. Since the two Semrush tokens are controlled separately, a site can block Site Audit specifically while still allowing or blocking SemrushBot's other crawling independently.
How to block it
Add this to robots.txt to block SiteAuditBot: User-agent: SiteAuditBot Disallow: / This only affects Semrush's Site Audit crawling; the main SemrushBot is controlled by its own separate robots.txt rule.
Frequently asked questions
Is SiteAuditBot the same as SemrushBot?
No. Semrush documents SiteAuditBot as a separate token specifically for its Site Audit tool, controlled independently of SemrushBot.
What does Semrush's Site Audit tool check for?
On-page SEO, technical, and usability issues that marketers and SEO teams use to fix their own sites.
Does blocking SiteAuditBot affect AI visibility?
No. It is an SEO audit crawler, unrelated to AI assistants or search indexing.
Related
- AI crawler directory — every AI crawler's robots.txt token, purpose and facts in one place.
- Free AI crawler checker — check which AI crawlers a domain's robots.txt actually allows or blocks.
- Glossary — definitions of the AI-visibility terms that come up alongside crawler behavior.
Sources
- SiteAuditBot is used to block SemrushBot's Site Audit crawling for different SEO and technical issues. Source: https://www.semrush.com/bot/ (checked Oct 2026)
MarketHQ tracks brand mentions across communities, news, blogs, social and AI answers, and turns them into gap analysis and action plans.