Database Queue - the simplest queue, even for shared hosting

IanM

1.0.0

No longer require a cron to queue:work, simply uses the scheduler ensure the scheduler cron is running (better support for shared hosting where cli access is limited/difficult)
Display a simple queue status on the admin dashboard

Install/Updating

composer require blomstra/database-queue:"*"
php flarum cache:clear

ctml

IanM glad to see the queue extension moved to an official extension, thank you 🙂

When I used to invoke the queue using flarum queue:work, there were some arguments it supported I think such as --sleep, --tries, --memory, is it possible/necessary to configure those still if upgrading and allowing the scheduler to invoke the queue? Reason being, I need to ensure it has enough memory and by default I believe it's granted 128 MB, but I need to bump that up.

MikeLundahl

IanM Hi, I'm a little confused. You mentioned that no cron is required anymore. But the documents still say:

Set up

Go into your hosting control panel and set up the following task to run every minute:

php flarum schedule:run
Or in cron language:

* * * * cd /path/to/flarum && php flarum schedule:run

Is it the documents/readme that haven't been updated? Just want to make sure things are setup correctly. (I just updated flarum and its extensions).

sylv38

Hello ! Thanks for your work !
I just made the update but I've got a little problem in admin. In the dashboard, the stats are not found because the /api/database-queue/stats returns 500/unkwnown response. Do you know if I could have made something wrong in setup ?

IanM

sylv38 can you share any relevant information from the flarum logs? A 500 error could be any number of reasons, but the logfile will point us to where the problem is

sylv38

IanM ok strange I've got this error each time I open the dashboard with the plugin active (I just masked my database name in log) :

[2023-11-28 09:32:43] flarum.ERROR: InvalidArgumentException: Database connection [*******] not configured. in /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/illuminate/database/DatabaseManager.php:161 Stack trace: #0 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/illuminate/database/DatabaseManager.php(124): Illuminate\Database\DatabaseManager->configuration('*******') #1 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/illuminate/database/DatabaseManager.php(95): Illuminate\Database\DatabaseManager->makeConnection('*******') #2 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/illuminate/queue/Failed/DatabaseUuidFailedJobProvider.php(150): Illuminate\Database\DatabaseManager->connection('*******') #3 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/illuminate/queue/Failed/DatabaseUuidFailedJobProvider.php(77): Illuminate\Queue\Failed\DatabaseUuidFailedJobProvider->getTable() #4 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/blomstra/database-queue/src/Api/Controller/ShowQueueStatsController.php(63): Illuminate\Queue\Failed\DatabaseUuidFailedJobProvider->all() #5 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Http/RouteHandlerFactory.php(41): Blomstra\DatabaseQueue\Api\Controller\ShowQueueStatsController->handle(Object(Laminas\Diactoros\ServerRequest)) #6 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Http/Middleware/ExecuteRoute.php(27): Flarum\Http\RouteHandlerFactory->Flarum\Http\{closure}(Object(Laminas\Diactoros\ServerRequest), Array) #7 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Flarum\Http\Middleware\ExecuteRoute->process(Object(Laminas\Diactoros\ServerRequest), Object(Closure)) #8 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Api/Middleware/ThrottleApi.php(33): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #9 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Flarum\Api\Middleware\ThrottleApi->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #10 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Http/Middleware/CheckCsrfToken.php(36): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #11 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Flarum\Http\Middleware\CheckCsrfToken->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #12 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Http/Middleware/ResolveRoute.php(69): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #13 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Flarum\Http\Middleware\ResolveRoute->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #14 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Http/Middleware/SetLocale.php(51): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #15 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Flarum\Http\Middleware\SetLocale->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #16 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Http/Middleware/AuthenticateWithHeader.php(58): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #17 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Flarum\Http\Middleware\AuthenticateWithHeader->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #18 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Http/Middleware/AuthenticateWithSession.php(31): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #19 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Flarum\Http\Middleware\AuthenticateWithSession->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #20 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Http/Middleware/RememberFromCookie.php(52): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #21 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Flarum\Http\Middleware\RememberFromCookie->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #22 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Http/Middleware/StartSession.php(61): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #23 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Flarum\Http\Middleware\StartSession->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #24 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Api/Middleware/FakeHttpMethods.php(29): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #25 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Flarum\Api\Middleware\FakeHttpMethods->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #26 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Http/Middleware/ParseJsonBody.php(28): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #27 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Flarum\Http\Middleware\ParseJsonBody->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #28 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Http/Middleware/HandleErrors.php(57): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #29 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Flarum\Http\Middleware\HandleErrors->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #30 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Http/Middleware/InjectActorReference.php(25): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #31 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Flarum\Http\Middleware\InjectActorReference->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #32 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/MiddlewarePipe.php(75): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #33 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/middlewares/request-handler/src/RequestHandler.php(84): Laminas\Stratigility\MiddlewarePipe->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #34 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Middlewares\RequestHandler->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #35 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/middlewares/base-path-router/src/BasePathRouter.php(99): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #36 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Middlewares\BasePathRouter->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #37 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Middleware/OriginalMessages.php(36): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #38 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Laminas\Stratigility\Middleware\OriginalMessages->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #39 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/middlewares/base-path/src/BasePath.php(73): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #40 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Middlewares\BasePath->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #41 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Http/Middleware/ProcessIp.php(24): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #42 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/Next.php(49): Flarum\Http\Middleware\ProcessIp->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\Next)) #43 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/MiddlewarePipe.php(75): Laminas\Stratigility\Next->handle(Object(Laminas\Diactoros\ServerRequest)) #44 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-stratigility/src/MiddlewarePipe.php(64): Laminas\Stratigility\MiddlewarePipe->process(Object(Laminas\Diactoros\ServerRequest), Object(Laminas\Stratigility\EmptyPipelineHandler)) #45 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/laminas/laminas-httphandlerrunner/src/RequestHandlerRunner.php(73): Laminas\Stratigility\MiddlewarePipe->handle(Object(Laminas\Diactoros\ServerRequest)) #46 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/vendor/flarum/core/src/Http/Server.php(45): Laminas\HttpHandlerRunner\RequestHandlerRunner->run() #47 /home/clients/50d3e640d21eed4e2418f41d6fd6963e/flarum/public/index.php(26): Flarum\Http\Server->listen() #48 {main}

IanM

sylv38 thanks, I am looking at the problem now and will come back with a solution ASAP for you

IanM

sylv38 please update to 1.0.1, I've published a temporary fix whilst I investigate further.

In this version, the failed jobs may not always be counted/displayed correctly, but I will address this fully in the next update.

sylv38

IanM Thank you, I confirm this time it works

Litalino

V1.0.1 OK GOOD

hrvoje_hr

Is it just a really weird coincidence that the database scheduler on my forum stopped working on this day today of all days? Even without the upgrade

IanM

1.0.2

full fix for failed jobs not being displayed correctly

Updating

composer require blomstra/database-queue:"*"
php flarum cache:clear

sylv38

IanM Great job thank you !

IanM

ctml you make a very good point actually. No, at present it does not support the additional args. It's easy enough to expose these as extensions settings, I'll get this added 🙂