Skip to content

Revert "feat: sitemap / robots.txt"#784

Closed
LadyBluenotes wants to merge 1 commit intomainfrom
revert-783-sitemap
Closed

Revert "feat: sitemap / robots.txt"#784
LadyBluenotes wants to merge 1 commit intomainfrom
revert-783-sitemap

Conversation

@LadyBluenotes
Copy link
Member

@LadyBluenotes LadyBluenotes commented Mar 26, 2026

Reverts #783

Summary by CodeRabbit

  • Bug Fixes

    • Removed auto-generated /sitemap.xml and /robots.txt endpoints to prevent duplicate content and SEO conflicts.
    • Removed dynamic canonical URL and robot meta tag injection from pages to streamline SEO handling.
  • Refactor

    • Simplified library configuration by removing sitemap-related settings.
    • Cleaned up SEO utilities to consolidate metadata handling.

@netlify
Copy link

netlify bot commented Mar 26, 2026

Deploy Preview for tanstack ready!

Name Link
🔨 Latest commit 4ef5d30
🔍 Latest deploy log https://app.netlify.com/projects/tanstack/deploys/69c4b3eb55b04100080e24c8
😎 Deploy Preview https://deploy-preview-784--tanstack.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.
Lighthouse
Lighthouse
1 paths audited
Performance: 45 (🔴 down 9 from production)
Accessibility: 90 (no change from production)
Best Practices: 83 (🔴 down 9 from production)
SEO: 97 (no change from production)
PWA: 70 (no change from production)
View the detailed breakdown and full score reports

To edit notification comments on pull requests, go to your Netlify project configuration.

@coderabbitai
Copy link

coderabbitai bot commented Mar 26, 2026

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: d1691926-e5e7-498c-8822-4a5751c8ef29

📥 Commits

Reviewing files that changed from the base of the PR and between 333b238 and 4ef5d30.

📒 Files selected for processing (9)
  • src/libraries/libraries.ts
  • src/libraries/types.ts
  • src/routeTree.gen.ts
  • src/routes/__root.tsx
  • src/routes/robots[.]txt.ts
  • src/routes/showcase/index.tsx
  • src/routes/sitemap[.]xml.ts
  • src/utils/seo.ts
  • src/utils/sitemap.ts
💤 Files with no reviewable changes (6)
  • src/routes/robots[.]txt.ts
  • src/libraries/types.ts
  • src/routes/sitemap[.]xml.ts
  • src/libraries/libraries.ts
  • src/routeTree.gen.ts
  • src/utils/sitemap.ts

📝 Walkthrough

Walkthrough

The pull request removes sitemap generation, robots.txt serving, and associated canonical URL/SEO handling infrastructure across multiple files. This includes deleting /sitemap.xml and /robots.txt file routes, the sitemap utility module, SEO canonicalization helpers, and sitemap configuration from library exports and type definitions.

Changes

Cohort / File(s) Summary
Library Configuration
src/libraries/libraries.ts, src/libraries/types.ts
Removed sitemap property with includeLandingPage and includeTopLevelDocsPages configuration from exported LibrarySlim type and all library constant exports (query, router, start, table, form, db).
Generated Route Definitions
src/routeTree.gen.ts
Removed generated TanStack Router entries for /sitemap.xml and /robots.txt routes, including type mappings in FileRoutesByFullPath, FileRoutesByTo, FileRoutesById, and related type unions.
File Route Handlers
src/routes/sitemap[.]xml.ts, src/routes/robots[.]txt.ts
Deleted route files that previously served dynamically generated sitemap XML and robots.txt content with appropriate Content-Type headers and caching directives.
Root Layout SEO Handling
src/routes/__root.tsx
Removed route-state-driven canonical path computation and conditional injection of <link rel="canonical"> and <meta name="robots"> tags into the document head.
Route-Specific SEO Logic
src/routes/showcase/index.tsx
Removed hasNonCanonicalSearch detection logic and its loader computation that flagged pages with non-default search parameters for noindex tagging.
SEO & Sitemap Utilities
src/utils/seo.ts, src/utils/sitemap.ts
Deleted entire sitemap.ts module (183 lines) containing sitemap entry aggregation and XML/robots.txt generation. Removed canonical path/indexing functions (getCanonicalPath, shouldIndexPath, canonicalUrl) from seo.ts; inlined SeoOptions type definition.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~25 minutes

Poem

🐰 The sitemaps fade, the robots stand down,
No XML crawls through our burrow town,
Simpler paths where once schemas grew,
A warren unburdened—refreshed and new! ✨

🚥 Pre-merge checks | ✅ 2 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Docstring Coverage ⚠️ Warning Docstring coverage is 0.00% which is insufficient. The required threshold is 80.00%. Write docstrings for the functions missing them to satisfy the coverage threshold.
✅ Passed checks (2 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly and specifically describes the main change: reverting a previous sitemap and robots.txt feature commit.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch revert-783-sitemap

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant