Skip to content

Docs: add llms.txt and robots.txt for AI assistants and answer engines - #394

Open
tuhaihe wants to merge 1 commit into
apache:mainfrom
tuhaihe:llms-txt
Open

Docs: add llms.txt and robots.txt for AI assistants and answer engines#394
tuhaihe wants to merge 1 commit into
apache:mainfrom
tuhaihe:llms-txt

Conversation

@tuhaihe

@tuhaihe tuhaihe commented Aug 17, 2026

Copy link
Copy Markdown
Member

Add root-level files to improve how AI assistants, answer engines, and search crawlers consume the site (GEO).

  • llms.txt: follows the llmstxt.org convention. Concise project introduction (PostgreSQL kernel, Greenplum alternative, migration via cbcopy), key features, links to stable 2.x documentation, Greenplum migration guides, and community/GitHub resources.
  • robots.txt: allows all crawlers and explicitly welcomes major AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, and others), grouped by vendor, with a Sitemap reference.

Both files are served from the site root (/llms.txt and /robots.txt).

closes: #ISSUE_Number


Change logs

Describe your change clearly, including what problem is being solved or what document is being added or updated.

Contributor's checklist

Here are some reminders before you submit your pull request:

Add root-level files to improve how AI assistants, answer engines, and
search crawlers consume the site (GEO).

- llms.txt: follows the llmstxt.org convention. Concise project
  introduction (PostgreSQL kernel, Greenplum alternative, migration
  via cbcopy), key features, links to stable 2.x documentation,
  Greenplum migration guides, and community/GitHub resources.
- robots.txt: allows all crawlers and explicitly welcomes major AI
  crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, and
  others), grouped by vendor, with a Sitemap reference.

Both files are served from the site root (/llms.txt and /robots.txt).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant