User-agent: * Disallow: /wp-admin/ Disallow: /wp-content/webtoffee_import Disallow: /(wp-content)/(.*?)\.(zip|gz|tar|csv|bzip2|7z)\$ Disallow: /cgi-bin/ Disallow: /downloader/ Disallow: /errors/ Disallow: /includes/ Disallow: /lib/ Disallow: /*?page=* Disallow: /*?add-to-cart=* Disallow: /*?add_to_wishlist=* Disallow: /checkout/cart* Disallow: /cart/ Disallow: /thank-you User-agent: EtaoSpider Disallow: / # slow down Yahoo User-agent: Slurp Crawl-delay: 5 Sitemap: https://shubhanjalistore.com/sitemaps.xml