Performance issues - Big discussion takes very long to load

Subarist

For a while just now, there were times when the page couldn't even load completely.

m4v3rick

It is just big discussions during match time.

Else it is pretty fast but discussions with more than 10k posts are really slow if many people are reading and some posting.

rob006

m4v3rick Flarum scales really badly for large discussions, because when you visit a discussion, it fetches ids of all posts in this discussion. If you have discussion with 10k posts, that is 10k posts that needs to be fetched from database (AFAIK only ID and type, but still this is 10k rows to find in DB), processed and generate JSON for them. And then client needs to work on this massive array of IDs.

Discourse has the same design, thus the same problem, and they decided to just not support this use case: https://meta.discourse.org/t/the-megatopic-public-good-or-public-menace/85592

rafaucau

rob006 Just adding additional context: This is an old and known issue that got lost in the archive of Flarum issues: flarum/issue-archive99

GreXXL

I stick to my original comment. If you install Redis and Realtime, working people won't have to reload "Live discussions" so often and thus improve the overall perceived performance dramatically. You have a specific use case for matches being discussed live, so this would work great in your setup. Have you introduced those things already?

Oshvam

rafaucau Thanks for this, I have been testing the performance without the Off follow tags extension as described in one of the comments and the performance increased considerably.

It's a shame this is not addressed, because that extension is critical to the forum.

m4v3rick

Oshvam

You mean this?

I had to turn off follow tags extension and remove loading of tagState (1.2m rows in DB), because response time was much bigger than 6s. But this is issue for flarum/tag.

Oshvam

m4v3rick yes.

m4v3rick

Oshvam

Do you know a way to split a discussion in two ore more parts? Split doesn't really works after like 10k posts.

Oshvam

m4v3rick If the extension doesn't work, the only thing I can think of is to create a new topic and move the messages from one topic to another with a SQL query.

GreXXL

m4v3rick I think @IanM is working on adding queue support to split to make it perform better on large discussions.

m4v3rick

Oshvam

Yeah, I thought the same but wasn't sure if I need to consider any tables I am not aware of.
Would you create a new discussion and set the date of that discussion to an older one before updating the posts and moving them?

GreXXL

Good to know. Thanks.

IanM

GreXXL That's correct. Should be ready sometime next week 🤞

« Previous Page