SemhackBot

Semhack fetches web pages with this user agent:

SemhackBot/1.0 (+https://semhack.com/bot)

When it visits

• Free tools: when a visitor checks a URL with one of our free tools, we fetch that single URL (and its redirects or robots.txt) once. These requests are made on demand by a person, so like other user-triggered fetchers they don't consult robots.txt.
• Site audits (coming later): customers will be able to crawl sites they have verified ownership of. The crawler will obey robots.txt rules for SemhackBot and limit itself to about one request per second per site.

How to block it

Add this to your robots.txt to stop crawls by SemhackBot:

User-agent: SemhackBot
Disallow: /

Problems?

If SemhackBot causes trouble on your site, email hello@semhack.com with the affected domain and approximate times, and we'll look into it right away.