Skip to content

OTWO-7712 robots.txt discloses sensitive internal paths — login, perm… - #1949

Open
Niharika1117 wants to merge 2 commits into
stagingfrom
OTWO-7712
Open

OTWO-7712 robots.txt discloses sensitive internal paths — login, perm…#1949
Niharika1117 wants to merge 2 commits into
stagingfrom
OTWO-7712

Conversation

@Niharika1117

Copy link
Copy Markdown
Contributor

…issions, session endpoints

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates robots.txt to reduce disclosure of potentially sensitive internal endpoints while keeping crawl controls for other areas.

Changes:

  • Removed several Disallow entries that explicitly listed internal/login/permission-related paths.
  • Updated the sitemap URL from HTTP to HTTPS.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread public/robots.txt
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants