Review: Flarum on AWS + CloudFlare (updated Oct 23, 2015)

viet

Netsoft Oh not sure why I thought of it that way. I'll review discourse again but will most likely stay with Flarum. For some reason I feel that Flarum can go a long way.

Netsoft

viet Yep, I like Flarum too. Can't wait for the final release.

Franz

viet Better PaaS like compability: Use external services whenever necessary. For example, most PaaS don't have a shared consistent file system, so it's better to generate new static contents (avatars, attachments) to external services like imgur, S3, Google Cloud Storage, etc..

The way e.g. the uploading code currently works will make it very easy to simply swap in adapters for other storage layers like S3 etc. We just have to make that configurable, and will do so. 🙂

tankerkiller125

I think (personally and through experience) that redis is a better Cache option than many if not all of the other solutions. Although I would never recommend it for storing extremely important data (full threads and what not) but as a cache option it works extremely well. Also after my own testing (auto-scaling groups and all) I find extremely similar results which just proves how consistent Flarum is compared to many/all of the other solutions.

viet

tankerkiller125 True that, redis is very fast, we use it for our Minecraft cluster to sync real time player data. Maybe Redis can be used for Flarums sessions/states.

Maybe Flarum can take advantage of both Memcached and Redis (both are supported by AWS's ElastiCache service), using both into their advantage. @Franz would know best what to do with Flarum performance. I can always help test to compare performances and load time.

I simply hope that the least data/packets are sent possible for each Flarum web request, so that users from far away can browse the forum feeling that everything loads instantly.

I'm currently in Vietnam, testing Flarum on both Oregon and Japan locations with the latency from Vietnam respectively 200ms and 100ms. I found that loading websites from Japan feels instant whereas loading the content box takes 1 to 2 seconds to load some times. It caused me to believe that more caching and opmitizing of packets being sent through the internet would be a nice solution.

Dominion

Great writeup @viet ! Just out of curiosity, who do you host with in Japan?

I look forward to reading the rest of your results.

viet

Dominion I use AWS for both Oregon and Japan location. However, Japan location doesn't have EFS (Elastic File System) to unify a /var/www folder across many instances.

I'm asking AWS to release EFS in Japan location, hopefully they'll consider. As of right now https://viet.vn is back in Oregon region.

Dominion

I see, thanks! I was wondering if you weren't back in Oregon now, it was feeling kinda sluggish to me. 😉

viet

Dominion As of right now it still feels sluggish to you?

For the sake of transparency and improving performance, lemme share a few technical details:

All of the EC2 instances are t2.micro (burstable CPU, 1GB RAM) which is the minimum configuration for AWS EC2.
I installed nginx, PHP5 on each EC2 instance.
external RDS MariaDB instance with 0.6GB RAM.
The mounted EFS shared file system that hosts /var/www has around 50Mbps disk throughput (burstable to 100Mbps according to AWS documentation).

Dominion

It feels a little faster now. (It's hard to say because my wife is hogging the internet.)

It wasn't really "sluggish" before ... just a little slower than I'd expect from a server in Japan.

viet

Dominion I changed the forum location to Japan. I really like this location for this specific website (because the target audience is Vietnamese & expats in Vietnam).

Just hope that I can autoscale a shared file system cluster if AWS doesn't release EFS in Japan.

Can you test and see how fast it load?

Dominion

A little bit faster. I'm seeing a latency of 40ms now, so the difference may be down to that, but ... I'm probably the wrong person to ask for help with such testing.

I live in a rural area, quite some distance from the nearest switching station, so my DSL line is slow at best and performance tends to vary a lot depending on the time of day, etc. (even when my wife isn't hogging the internet). So small differences tend to get lost in the general horribleness of my internet connection. 😛

I've been wondering ... Why not use the Singapore location? Is your audience in the US as well as SE Asia?

viet

Dominion Great thanks! 40ms is great.

Sometimes slow internet connection is great for testing Flarum's performance. 😛 If the software couldn't serve users with slow internet instantly, then something needs to change.

I don't like Singapore, because I also want to target United States people who are interested in Vietnam, and Vietnamese people who live in the US lol.

Dominion

viet Sometimes slow internet connection is great for testing Flarum's performance. If the software couldn't serve users with slow internet instantly, then something needs to change.

True! From that perspective, it seems to be working just fine. The other problem is that I'm not used to seeing how Flarum performs over SSL, so it just feels really slow.

viet I don't like Singapore, because I also want to target United States people who are interested in Vietnam, and Vietnamese people who live in the US lol.

I thought that must be what you have in mind. Tokyo's certainly a good location for that. 🙂

Simdol

Dominion

I've been using SSL with Flarum ever since I've started to use Flarum. I've noticed no performance differences in my opinion with or without SSL. I think it rather depends on the SSL negotiation in the web server side, not performance issue from Flarum.

What happens is that if you are using CloudFlare, while it does improve loading time, it does increase the initial page loading time due to website being proxied twice before getting to the visitor. While using other static CDN solution could solve those problems, I generally don't see a point in using CloudFlare if you are using AWS or other CDNs.

viet

Simdol Great question! For many peole and in many cases, CloudFlare isn't the best option. However, in my case, it is. I chosed CloudFlare because of the following reasons:

It's fast: The thing with CloudFlare and AWS is, they're in the same data center at many locations, including Japan. Both use Equinix as data center and use Equinix Cloud Exchange to communicate between each others (just like Google, Softlayer). Traffic from CloudFlare can use the fast pipe to go to AWS, and all of those traffic isn't necessarily routed to the internet but rather via private line. As a result, it is fast and secure.
Locations: Although my back end is in Japan, the closest data center from Vietnam to the website is CloudFlare's Hong Kong. In this case, CF helps tremendously in optimizing the traffic route, especially during normal day time when internet congestion usually occur in my city.
Security: I don't want to just use Static CDN solution and leave AWS ELB as front end because I don't want to get hit with DDoS attack. AWS ELB isn't going to save me from such attack. While with CloudFlare, I can mitigate small attack and if my site goes popular, I can upgrade the plan when I see fit.
Flexible SSL: I like how CloudFlare provide Flexible SSL and terminate it at CloudFlare level, so no performance hit on the backend instances here. There's no security risk because of the same data center with AWS, and it improves how SSL is handled.
Dynamic content caching: My site has CloudFlare Railgun enabled, which is a feature to optimize and cache dynamic content (dynamic content is cached via Memcached, ikr 🙂 ). While Akamai, Fastly and Cloudfront also support something like that, most only route dynamic content and not cache it, the one who does is expensive, I'd rather go with CloudFlare. Simply use the following command to test, you'll see the site usually achieves over 90% compression on both dynamic and static contents. It saves me bandwidth cost with AWS. Time to first byte is optimal so page load time is actually optimized and lower than if I go direct to AWS ELB.

for i in {1..15}; do curl -svo /dev/null https://viet.vn 2>&1 |egrep 'Cf-';done