Repository navigation
Sitemap: AI models missing on dev and prod (numeric ids filtered out) #455
Description
What: every aimodels-N.xml child sitemap serves an empty <urlset>, on prod as well as dev. Prod lists aimodels-1.xml with 0 urls, while the prod backend has 15 public, active AI models.
Why it matters: no AI model pages are in the sitemap, so search engines aren't pointed to them.
Evidence: isEntityItem in app/sitemap/[entityPage]/route.ts (added in d750e88, 2026-08-31) keeps only string ids, but the API returns AI model ids as numbers: {"id": 44}.
Fix: #495 accepts string | number ids. Tested locally against the prod backend: 0 → 15 urls.
Earlier diagnosis was wrong: this issue was first put down to dev pagination and closed as not planned. Pagination isn't involved.
Activity
saqibmanan commentedon Sep 9, 2026
Closing: SEO is not required on dev, so the empty aimodels sitemaps have no impact there. Prod is unaffected today — it serves 15 aimodels urls correctly.
Recording the latent risk before closing, since prod is safe by accident rather than by design: this failure only appears where the sitemap is paginated. Prod is unpaginated solely because
FEATURE_SITEMAP_ITEMS_PER_PAGEnever reaches the EC2 runtime (same GH-Actions-var-vs-EC2-.env disconnect asFEATURE_SITEMAPS) and falls back to the 1000 default. That var is already set to 5 in prod, so whenever the propagation bug is fixed, prod paginates at 5/page and would hit this immediately. Prod would also paginate naturally at >1000 datasets (currently 234).Reopen if prod sitemaps ever start paginating.
Test side:
test_sitemap_aimodels_count_matches_backendin CivicDataSpace-test is markedxfail(strict=True)pointing at this issue, so it will report XPASS the moment the behaviour changes.[-]dev sitemap: aimodels child sitemaps serve 0 urls while index advertises 5 pages[/-][+]Sitemap: AI models missing on dev and prod (numeric ids filtered out)[/+]saqibmanan commentedon Oct 7, 2026
Reopening: the earlier diagnosis was wrong. Prod is affected too, and the cause is the string-only id filter, not pagination. Fix in #495.
saqibmanan commentedon Oct 7, 2026
#495 merged and deployed to dev 2026-10-07. Dev's sitemap is now off (#493), so the fix can only be confirmed on prod. Waiting for the next dev → main deploy; CivicDataSpace-test's prod aimodels count check starts running on its own once prod serves it.
saqibmanan commentedon Oct 9, 2026
On prod since the 2026-10-09 release (#500,
92cd5219): https://civicdataspace.in/sitemap/aimodels-1.xml lists 15 URLs.