# SmartCut — https://smartcut.dev User-agent: * Allow: / Disallow: /auth/ # AI assistants & answer-engine crawlers — explicitly allowed so our content can # be indexed and cited. User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Claude-Web User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Amazonbot Allow: / Disallow: /auth/ # AI TRAINING crawlers and training-use tokens — our content may be read (so it can # be cited), but our CODE is proprietary to Cut Revolution and not licensed for # training: the built scripts and styles are off limits. (The same notice heads # every built file; utilities/vite/vite-plugin-proprietary-notice.ts.) User-agent: GPTBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: CCBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Meta-ExternalAgent Allow: / Disallow: /auth/ Disallow: /assets/ Disallow: /_astro/ Disallow: /checkout/ Disallow: /widget/ # Authoritative sitemap — generated by utilities/sitemap/generate-sitemap-sc.ts. # It covers the co-hosted app SPA routes as well as the marketing pages, so it is # a superset of the sitemap-index.xml that Starlight's bundled @astrojs/sitemap # emits (that one is marketing-only and cannot be filtered from brandConfig). Sitemap: https://smartcut.dev/sitemap.xml # Storefront material pages, one sitemap index per published shop that has no domain of its own # (a shop on its own domain is canonical there and publishes its own sitemap at that domain's root). # Generated at request time by server/api/ecommerce-sitemaps.ts, because the set of shops and the # materials in them changes without a deploy. Sitemap: https://smartcut.dev/sitemap-stores.xml