User-Agent: * Disallow: /private/ Disallow: /cgi-bin/ # Wordpress Disallow: /admin/ Disallow: /author* Disallow: /files/ Disallow: /sites/ Disallow: /uploads/ Disallow: /wp-admin/ # Other Disallow /.env Disallow /.git # Disallow /_ignition/ Disallow /gpon/ Disallow /Gpon/ Disallow /owa/ Disallow /manager/ Disallow: /shell* Disallow /solr/ Disallow /version Disallow /webfig Sitemap: https://www.fruithouse.co.uk/sitemap.xml.gz Crawl-delay: 30