INETDEX Bot

Information for website operators about the INETDEX crawler.

What does the bot do?

The bot automatically discovers and visits publicly accessible web pages for indexing and technical analysis.

Crawler identification

Requests generated by the crawler identify the software using the User-Agent shown above.

Blocking the crawler

Website operators can restrict crawler access at the web-server, firewall or application level. If your crawler supports robots.txt rules, document the exact policy here before claiming robots.txt compliance.

Problems or questions?

If you notice unusual crawler activity or want to contact the INETDEX operator, use the contact page.