Tankerkiller125 yes it's a known limitation.
clarkwinkelmann If there's interest I can implement the links limit (number and file size) according to the sitemap specs. The specs says there shouldn't be more than 50k links per sitemap file. For now it will keep growing forever. I'm not sure what is the actual search engine behavior if you exceed 50k links per file.
If we implement sitemap split, then I think the best (most efficient) solution will be to have one group of files for each data type, that way we can effectively use pagination in the database queries. If we keep a single group of files and just split after 50k links, we would still have to retrieve everything in order to know in which file it switches from users to discussions for example.
The questions then is, do search engines prefer to have as few sitemaps as possible, or do they don't care if we have one set for each data type ? 🤔
If someone wants to commission it, I'll happily work on it. I guess it's a matter of a few hours at maximum.