Fetches /robots.txt, parses user-agent groups and sitemap directives, then optionally crawls a sitemap.
/robots.txt
This site uses Google Analytics to count visits. Nothing else is tracked. See Privacy.