Google Sitemaps and Billions of Pages

[tomgould]

Tweet

Hi Guys

I am building a site at the moment with a ridiculously large number of pages

There is 1 section alone that has over 220 Billion top level pages and i estimate that the finished site will have somewhere in the region of 100 Trillion pages (100,000,000,000,000)

Any ideas as how best to approach this issue.

I have been thinking about listing only the really important (Top Level) pages that then link to these sub pages but would like to be able to list Millions of pages at least in my sitemaps

[jmd4eva]

how about subdomaining different categories?

so http://www.mainsite.com, then http://category1.mainsite.com - you can submit different sitemaps for each subdomain...

[jmarch]

You could try multiple sitemaps (one for each section)