# NorthPoint — robots.txt # # DO NOT add "Disallow: /partials/" or "Disallow: /api/" here. # Those paths are de-indexed with an "X-Robots-Tag: noindex" response header # (see the headers block in vercel.json). A crawler has to be ABLE to fetch a # URL to see that header. Disallowing them in robots.txt would block the fetch, # the noindex would never be read, and anything Google already holds — e.g. # /partials/suite-cta, which was sitemap-listed from 2026-07-11 until the loc # was removed on 07-26 — would stay in the index indefinitely. Crawlable + # noindex is the combination that actually removes a URL. # Default crawlers User-agent: * Allow: / Disallow: /account Disallow: /sign-in # AI answer engines & generative crawlers — explicitly welcome. # NorthPoint publishes operator-grade compliance references; we want them cited. # # NOTE: a robots.txt group is NOT inherited. Every group below must repeat the # Disallow lines or it silently reverts to "Allow: /" — which is how the # /sign-in and /account exclusions came to apply to GPTBot and to nothing else. # If you add a crawler group, copy the three Disallow lines with it. User-agent: GPTBot Allow: / Disallow: /account Disallow: /sign-in User-agent: OAI-SearchBot Allow: / Disallow: /account Disallow: /sign-in User-agent: ChatGPT-User Allow: / Disallow: /account Disallow: /sign-in User-agent: ClaudeBot Allow: / Disallow: /account Disallow: /sign-in User-agent: Claude-Web Allow: / Disallow: /account Disallow: /sign-in User-agent: anthropic-ai Allow: / Disallow: /account Disallow: /sign-in User-agent: PerplexityBot Allow: / Disallow: /account Disallow: /sign-in User-agent: Perplexity-User Allow: / Disallow: /account Disallow: /sign-in User-agent: Google-Extended Allow: / Disallow: /account Disallow: /sign-in User-agent: Applebot-Extended Allow: / Disallow: /account Disallow: /sign-in User-agent: CCBot Allow: / Disallow: /account Disallow: /sign-in # Machine-readable entity summary for LLMs: https://northpoint.fi/llms.txt Sitemap: https://northpoint.fi/sitemap.xml