About our website scanner

EssentialDevToolsBot inspects publicly available website signals.

Identification

Our user agent is EssentialDevToolsBot/1.0 (+https://essentialdevtools.com/crawler/). Scans are initiated by a visitor entering a URL. There is no scheduled internet-wide crawler.

What we request

We request robots.txt, a public HTML page, and up to two relevant WordPress theme stylesheets from the same origin. We do not submit forms, execute JavaScript, authenticate, access admin APIs, or bypass bot challenges. We limit response sizes, requests, scan time, and concurrent scans.

Control scanning of your website

To disallow this scanner, add these rules to your robots.txt:

User-agent: EssentialDevToolsBot
Disallow: /

We honor matching allow and disallow rules. When the crawling policy cannot be read safely, we stop rather than assume permission. Already cached reports may remain available for up to 30 minutes.

Detection limitations

A public signal is not proof that a service is enabled for every visitor. Missing signals do not prove absence. Versions and theme identities are self-reported when exposed, and origin hosting may be hidden behind a CDN.