Redis sessions, cache & queues

Alkir

Is it possible to use this extension on shared hosting without shh

luceos

Alkir Is it possible to use this extension on shared hosting without shh

No. You need access to a running redis instance. This extension is most definitely not for a regular shared hosting environment.

matteocontrini what happens if the enqueue operation fails?

If queueing of the Job fails, the request fails and the user gets direct feedback. If you use something like Sentry you will be notified as well. This erroring is exactly the same behavior with how it works by default in Flarum (called the sync driver). The message now is also still posted, but you will see an error (if I'm not mistaken).

matteocontrini what happens if the Laravel process is for some reason offline?

The job is queued nevertheless. If no workers are running no notifications are send. If you start a worker it will automatically pick up any items in the queue, starting from the oldest.

You can configure redis to persist its state to disk, so that the queue jobs are persisted to disk when redis or the server is restarted!

matteocontrini the queue worker sends the 10 email messages one by one

Queues allow easy scaling. You can run multiple workers at once, even remotely. As long as those remote servers can connect to the redis and database instance and run the same code/configuration. Queues are far more scalable than in-request processing (sync) of notifications.

matteocontrini what happens if sending an email fails?

You can configure this in the worker. php flarum queue:work --tries=4 will make the worker attempt jobs 4 times.

I can recommend using the fof/sentry package with this extension. This makes it easier to catch any issues with Jobs being processed in the queue.

matteocontrini

luceos so if I understand correctly, this is what would happen with queues (plus questions):

10 people are subscribed to a topic
a user posts a new message in the topic
instead of being sent immediately, the 10 emails are put into the Redis queue
[what happens if the enqueue operation fails? is the message still posted without email notifications?]
the long-running background Laravel process gets the items from the queue and processes them
[what happens if the Laravel process is for some reason offline? are the queue items persisted for when the worker comes online, or does the system use pubsub so items are lost?]
the queue worker sends the 10 email messages one by one
[what happens if sending an email fails? is it retried or discarded? is there a limit of retries?]

Cheers!

matteocontrini

luceos thanks! (I should have read the Laravel docs better anyway 😅)

Hiob

Hi @luceos, I just want to say thank you! You doing a great job, as usual. 😃
Really simple to install, really effective!

For redis, I used the docker image bitnami / redis with docker-compose, it works like a charm.

mekici

luceos

root@lemp-s-1vcpu-2gb-fra1-01:/var/www/beta13# php flarum queue:work


  There are no commands defined in the "queue" namespace.


root@lemp-s-1vcpu-2gb-fra1-01:/var/www/beta13# php flarum queue:work -vvv

In Application.php line 597:

  [Symfony\Component\Console\Exception\NamespaceNotFoundException]
  There are no commands defined in the "queue" namespace.


Exception trace:
  at /var/www/beta13/vendor/symfony/console/Application.php:597
 Symfony\Component\Console\Application->findNamespace() at /var/www/beta13/vendor/symfony/console/Application.php:650
 Symfony\Component\Console\Application->find() at /var/www/beta13/vendor/symfony/console/Application.php:235
 Symfony\Component\Console\Application->doRun() at /var/www/beta13/vendor/symfony/console/Application.php:147
 Symfony\Component\Console\Application->run() at /var/www/beta13/vendor/flarum/core/src/Console/Server.php:44
 Flarum\Console\Server->listen() at /var/www/beta13/flarum:24

root@lemp-s-1vcpu-2gb-fra1-01:/var/www/beta13#

I set extend.php as described. LEMP on the server
The redis server has been successfully installed but I get such an error. Where could the problem be?

luceos

mekici did you enable the extension in your admin area?

mekici

luceos yes i enabled but since i subscribed to the recache plugin this is not needed 😀

https://discuss.flarum.org/d/20791-recache-speed-up-your-forum/126 can you help with this problem?

Cagdas

luceos The plugin is not showing on my admin page.

DursunCan

<?php

/*


 * This file is part of Flarum.
 *
 * (c) Toby Zerner <toby.zerner@gmail.com>
 *
 * For the full copyright and license information, please view the LICENSE
 * file that was distributed with this source code.
 */

use Flarum\Extend;

return [
    // Register extenders here to customize your forum!
];

return [
    new Bokt\Redis\Extend\EnableRedisCache([
        'host' => '127.0.0.1',
        'password' => null,
        'port' => 6379,
        'database' => 1,
    ]),
];

return [
    new Bokt\Redis\Extend\EnableRedisQueue([
        'host' => '127.0.0.1',
        'password' => null,
        'port' => 6379,
        'database' => 1,
    ]),
];

php flarum queue:work

                                                           
  There are no commands defined in the "queue" namespace.

plugin is active. why might it be like this?

datitisev

DursunCan One cannot return multiple values using return. You are returning the initial empty array with return [ ].

After the use line, your extend.php should look like this. Note that I replaced the repeated config with a variable, this way you only have to change the values once.

return [
    new Bokt\Redis\Extend\EnableRedisCache($redis = [
        'host' => '127.0.0.1',
        'password' => null,
        'port' => 6379,
        'database' => 1,
    ]),
    new Bokt\Redis\Extend\EnableRedisQueue($redis),
];

DursunCan

datitisev I wrote the command and it looks like the picture. Waiting. It's been over 5 minutes. Is this normal?

datitisev

DursunCan Yes. The queue:work command listens to the Redis DB for queue jobs and runs them when any are added. It will not end until you tell it to.

You probably want to set up a service that runs php flarum queue:work continuously like supervisord or systemctl.

DursunCan

luceos Bokt/flarum-redis2

Gatsu

luceos Thank you for this.
Do you suggest to activate both? (Queque and cache)

luceos

Gatsu depends on the size of your community and how active it is. Using the cache really can't hurt. Using the queue requires you to understand that it has to be restarted when updating flarum or when adding extensions.

Gatsu

luceos Thank you for the explanation. As I understand it, there should be no problem activating the Redis cache with Opcache, right?

luceos

Gatsu not at all, they're two different things. Opcache caches your php files (code), redis replaces the file cache for views, session etc.

rob006

luceos redis replaces the file cache for views

Views are compiled to PHP files. Do you store them in redis too?

luceos

rob006 it replaces the complete Cache store in Flarum. I'd have to trace it back, but it should be the case, yes.

rob006

luceos How this could be more efficient than saving and reading these files from disk? They're read-heavy, so they should already be in disk cache in RAM and reading them should be faster than querying redis. Not mention opcache which works out of the box for files saved on disk, but I'm not sure how you managed to make it work if you store these files in redis.

luceos

rob006 diving deeper into this, it seems that the FileViewFinder in fact uses the Filesystem directly 👍️

« Previous Page Next Page »