Help Center

Need assistance?

Find answers to your questions regarding WebAtlas Index, site indexing, and API integration.

Frequently Asked Questions (FAQ)

?

How do I add my site to the index?

You can submit your website directly via the "Add your page" form on our homepage. Our crawlers will automatically discover and verify your domain.

?

Is WebAtlas API free to use?

Websites are indexed by WebAtlasBot into the index for free, whereas the API requires a paid subscription.

?

How do I exclude my site from indexing?

WebAtlasBot follows standard robots.txt protocols. Add specific 'Disallow' rules for WebAtlasBot in your robots.txt file to prevent crawling.

?

How often does WebAtlasBot crawl websites?

Crawl frequency depends on the popularity and update rate of your content. Our bots optimize the process to ensure search results remain current without overloading your server.

?

What is NetKrypton verification?

NetKrypton is our integrated security system that scans domains for malicious content, phishing, and threats. This ensures that MevaSearch users receive safe and reliable search results.

?

Does WebAtlasBot respect Crawl-delay?

Yes, our crawlers are designed to be server-friendly. We respect standard robots.txt directives and parameters to ensure the performance of your infrastructure is maintained.

?

How can I manage my domain status via API?

The WebAtlas API allows you to submit URLs, check indexing status, and manage your domain's presence in our index. Detailed instructions are available in our API documentation.