exq

Exq

Exq is a job processing library compatible with Resque / Sidekiq for the Elixir language.

• Exq uses Redis as a store for background processing jobs.
• Exq handles concurrency, job persistence, job retries, reliable queueing and tracking so you don't have to.
• Jobs are persistent so they would survive across node restarts.
• You can use multiple Erlang nodes to process from the same pool of jobs.
• Exq uses a format that is Resque/Sidekiq compatible.
  • This means you can use it to integrate with existing Rails / Django projects that also use a background job that's Resque compatible - typically with little or no changes needed to your existing apps. However, you can also use Exq standalone.
  • You can also use the Sidekiq UI to view job statuses, as Exq is compatible with the Sidekiq stats format.
  • You can run both Exq and Toniq in the same app for different workers.
• Exq supports uncapped amount of jobs running, or also allows a max limit per queue.
• Exq supports job retries with exponential backoff.
• Exq supports configurable middleware for customization / plugins.
• Exq tracks several stats including failed busy, and processed jobs.
• Exq stores in progress jobs in a backup queue (using the Redis RPOPLPUSH command). This means that if the system or worker is restarted while a job is in progress, the job will be re_enqueued when the node is restarted and not lost.
• Exq provides an optional web UI that you can use to view several stats as well as rate of job processing.
• When shutting down Exq will attempt to let workers terminate gracefully, with a configurable timeout.
• There is no time limit to how long a job can run for.