Alkir Server response time to generate the page, or for you to load it?
If you're running into issues with the former, this is probably due to your server's configuration. Check what other high-memory/processor-heavy programs are running and either reduce them or move to a server with increased specs. If your mysql database is hosted on a separate server, that connection can provide a bottleneck, especially if your site is being hit with numerous connections at once. Basically, it's unlikely that Flarum itself is creating such a long response time, this all comes down to how fast your server processes the page requests.
If the issue is the latter, this is likely due to your internet speeds and physical connection to the server itself. Servers that are farther away, or have several layers of the network between you and it, will be slower than those physically closer. This is going to be solely an ISP/network/server location issue, though and not Flarum.