User-agent: * Disallow: /wp-admin/ Disallow: /documents/GE/ Disallow: /wp-login.php Allow: /wp-admin/admin-ajax.php Crawl-delay: 600 User-agent: AhrefsSiteAudit Allow: /* User-agent: AhrefsBot Allow: /* User-agent: Baiduspider Disallow: / User-agent: Baiduspider-image Disallow: /