Performance issues - Big discussion takes very long to load

m4v3rick

Sorry for the late reply and many thanks for your help.
I haven't been around my pc these days.

GreXXL loading this discussion as a guest does not perceive slow. It's loading in 1,4-1,6s for me. It, of course, depends also on the number of extensions that need to get loaded as well as the content that is embedded. You lose a couple of ms for every embedded tweet - but it still loads quite well.

It happens to be slower if there are more posting user online which is often during football matches.

GreXXL I can cycle back to the missing queue.

That is next on my roadmap for sure.

GreXXL What you could also do is to add Realtime to your arsenal

We had that. We acutally bought websockets by kyrne. But it had some issues and short time after our purchase he made it free for all and didn't maintain it any more with those open issues. To be honest, that was a punch in our face kind of.
Also users were quite happy with manually pushing refresh. Maybe because websockets was buggy, caused huge performance issues and therefore users got annoyed.

GreXXL PS.: As a fellow Austrian

Now that's great: Servas 😉

Oshvam that it wouldn't look weird to see a spanish guy posting on an austrian site xD.

Oh, I could just make a user for you to test and I could delete the posts afterwards. That ain't a problem. The community is pretty friendly so no worries.

Oshvam GTMETRIX

I used that already in 2021 for some time with a former very active flarum user who helped me a bit with performance issues at the beginning. Sadly he deleted his account here.

Oshvam performance problems

Some user complained about performance issues but only in the discussion I posted above and mostly during a match day.

Oshvam DNS Prefetch method I detailed in this discussion

I will take a closer look at this. Thanks.

Maybe it will be redis and dns prefetch but for sure I will start with redis first. Just need to find some spare time for it and maybe a little help.

GreXXL

m4v3rick please report back once you have set up a queue. Maybe you can also tune your php settings to allow more threads to be spun up if you have issues with more users online simultaneously. I do think web sockets (if set up correctly) could also improve the concurrent user problem within the same discussion and would be perceived much more like a "live" conversation.

m4v3rick

GreXXL

Oshvam

At the moment it is slow if you guys wanna check it.

Subarist

m4v3rick
My feeling is that this site is so slow that almost unusable.

m4v3rick

Subarist

It is just big discussions during match time.

Else it is pretty fast but discussions with more than 10k posts are really slow if many people are reading and some posting.

Subarist

For a while just now, there were times when the page couldn't even load completely.

rob006

m4v3rick Flarum scales really badly for large discussions, because when you visit a discussion, it fetches ids of all posts in this discussion. If you have discussion with 10k posts, that is 10k posts that needs to be fetched from database (AFAIK only ID and type, but still this is 10k rows to find in DB), processed and generate JSON for them. And then client needs to work on this massive array of IDs.

Discourse has the same design, thus the same problem, and they decided to just not support this use case: https://meta.discourse.org/t/the-megatopic-public-good-or-public-menace/85592

rafaucau

rob006 Just adding additional context: This is an old and known issue that got lost in the archive of Flarum issues: flarum/issue-archive99

GreXXL

I stick to my original comment. If you install Redis and Realtime, working people won't have to reload "Live discussions" so often and thus improve the overall perceived performance dramatically. You have a specific use case for matches being discussed live, so this would work great in your setup. Have you introduced those things already?

Oshvam

rafaucau Thanks for this, I have been testing the performance without the Off follow tags extension as described in one of the comments and the performance increased considerably.

It's a shame this is not addressed, because that extension is critical to the forum.

m4v3rick

Oshvam

You mean this?

I had to turn off follow tags extension and remove loading of tagState (1.2m rows in DB), because response time was much bigger than 6s. But this is issue for flarum/tag.

Oshvam

m4v3rick yes.

m4v3rick

Oshvam

Do you know a way to split a discussion in two ore more parts? Split doesn't really works after like 10k posts.

Oshvam

m4v3rick If the extension doesn't work, the only thing I can think of is to create a new topic and move the messages from one topic to another with a SQL query.

GreXXL

m4v3rick I think @IanM is working on adding queue support to split to make it perform better on large discussions.

m4v3rick

Oshvam

Yeah, I thought the same but wasn't sure if I need to consider any tables I am not aware of.
Would you create a new discussion and set the date of that discussion to an older one before updating the posts and moving them?

GreXXL

Good to know. Thanks.

IanM

GreXXL That's correct. Should be ready sometime next week 🤞

« Previous Page