# https://www.robotstxt.org/robotstxt.html User-agent: * Allow: / # Disallow admin/API paths Disallow: /api/ # Sitemap Sitemap: https://www.csgtech.in/sitemap.xml