User-agent: *
Disallow: /pub
Crawl-delay: 60