# Robots.txt for sardarayazkhan.com # Allow all search engines to crawl the entire site User-agent: * Allow: / # Sitemap location Sitemap: https://www.sardarayazkhan.com/sitemap.xml # Crawl-delay for respectful crawling (optional) Crawl-delay: 1 # Disallow backup files Disallow: /*.backup$ Disallow: /*GUIDE.md$ Disallow: /*UPDATE-SUMMARY.md$ Disallow: /README.md