Crawler documentation
Remove your page from the index.
If your site shouldn't appear in WebAtlas Index, you can request its removal yourself. We verify every request automatically before removing anything — nothing is deleted on request alone.
Crawler documentation
If your site shouldn't appear in WebAtlas Index, you can request its removal yourself. We verify every request automatically before removing anything — nothing is deleted on request alone.
Add a noindex meta tag to the page itself, or block that exact path in robots.txt. Submit the page's URL in the tool below — once we confirm either one, it's removed automatically.
<meta name="robots" content="noindex">To remove everything under a path (e.g. /blog/), block that path for WebAtlasBot in robots.txt:
User-agent: WebAtlasBot
Disallow: /blog/No access to robots.txt? Submit the path in the tool below instead. We'll give you a small verification file to upload at your site's root — once found, every URL under that path is removed and permanently excluded from future crawls.
To remove a whole domain, disallow everything for WebAtlasBot in robots.txt:
User-agent: WebAtlasBot
Disallow: /Same as above — if you can't edit robots.txt, submit the domain in the tool below and upload the verification file we generate for you.
Pending requests are rechecked automatically about once an hour. As soon as a request is confirmed, matching pages are removed from the index immediately.
Once a removal is confirmed, the URL, path, or domain is permanently excluded — our crawlers will never re-add it to the index, even if they encounter it again later.
Crawler documentation
The removal tool runs on our crawler infrastructure. Choose what you want to remove, submit it, and follow the verification instructions shown there.