• Add hook (Huey.build_error_result) for customizing the error result metadata.
• Avoid crashing if another module already modified/set the multiprocessing start method.

View commits

• Add SIGNAL_INTERRUPTED to signal when a task is interrupted when a consumer exits abruptly.
• Use the Huey.create_consumer() API within the Django management command, to allow Django users to customize the creation of the Consumer instance.

View commits

• Use monotonic clock for timing operations within the consumer.
• Ensure internal state is cleaned up on file-lock when released.
• Support passing around TaskException as a pickled value.
• Set the multiprocessing mode to "fork" on MacOS and Python 3.8 or newer.
• Added option to enforce FIFO behavior when using Sqlite as storage.
• Added the on_shutdown handler to djhuey namespace.
• Ensure exception is set on AsyncResult in mini-huey.

View commits

• Fix task repr (refs #460).
• Adds task-id into metadata for task exceptions (refs #461).
• Ensure database connection is not closed when using the call_local method of Django helper extension db_periodic_task().
• Allow pickle protocol to be explicitly configured in serializer parameters.
• Adds FileHuey and full FileStorage implementation.
• Add shutdown() hook, which will be run in the context of the worker threads/processes during shutdown. This hook can be used to clean-up shared or global resources, for example.
• Allow pipelines to be chained together. Additionally, support chaining task instances.

View commits

• Fix semantics of SIGNAL_COMPLETE so that it is not sent until the result is ready.
• Use classes for the specific Huey implementations (e.g. RedisHuey) so that it is easier to subclass / extend. Previously we just used a partial application of the constructor, which could be confusing.
• Fix shutdown logic in consumer when using multiprocess worker model. Previously the consumer would perform a "graceful" shutdown, even when an immediate shutdown was requested (SIGTERM). Also cleans up the signal-handling code and ensures that interrupted tasks log a warning properly to indicate they were interrupted.

View commits

• Allow AsyncResult object used in MiniHuey to support the __call__() method to block and resolve the task result.
• When running the django run_huey management command, the huey loggers will not be configured if another logging handler is already registered to the huey namespace.
• Added experimental contrib storage engine using kyoto tycoon <http://fallabs.com/kyototycoon>_ which supports task priority and the option to do automatic result expiration. Requires the ukt <https://github.com/coleifer/ukt>_ python package and a custom kyototycoon lua script.
• Allow the Sqlite storage engine busy timeout to be configured when instantiating SqliteHuey.

View commits

• Ensure that task()-decorated functions retain their docstrings.
• Fix logger setup so that the consumer log configuration is only applied to the huey namespace, rather than the root logger.
• Expose result, signal and disconnect_signal in the Django huey extension.
• Add SignedSerializer, which signs and validates task messages.
• Refactor the SqliteStorage so that it can be more easily extended to support other databases.

View commits

• Added new contrib module sql_huey, which uses peewee <https://github.com/coleifer/peewee>_ to provide storage layer using any of the supported databases (sqlite, mysql or postgresql).
• Added RedisExpireHuey, which modifies the usual Redis result storage logic to use an expire time for task result values. A consequence of this is that this storage implementation must keep all result keys at the top-level Redis keyspace. There are some small changes to the storage APIs as well, but will only possibly affect maintainers of alternative storage layers.
• Also added a PriorityRedisExpireHuey which combines the priority-queue support from PriorityRedisHuey with the result-store expiration mechanism of RedisExpireHuey.
• Fix gzip compatibility issue when using Python 2.x.
• Add option to Huey to use zlib as the compression method instead of gzip.
• Added FileStorageMethods storage mixin, which uses the filesystem for task result-store APIs (put, peek, pop).
• The storage-specific Huey implementations (e.g. RedisHuey) are no longer subclasses, but instead are partial applications of the Huey constructor.

View commits

• Small fixes, fixed typo in Exception class being caught by scheduler.

View commits

View commits

This section describes the changes in the 2.0.0 release. A detailed list of
changes can be found here: https://huey.readthedocs.io/en/latest/changes.html

Overview of changes:

• always_eager mode has been renamed to immediate mode. Unlike previous
  versions, immediate mode involves the same code paths used by the consumer
  process. This makes it easier to test features like task revocation and task
  scheduling without needing to run a dedicated consumer process. Immediate
  mode uses an in-memory storage layer by default, but can be configured to use
  "live" storage like Redis or Sqlite.
• The events stream API has been removed in favor of simpler callback-driven
  signals APIs. These
  callbacks are executed synchronously within the huey consumer process.
• A new serialization format is used in 2.0.0, however consumers running 2.0
  will continue to be able to read and deserialize messages enqueued by Huey
  version 1.11.0 for backwards compatibility.
• Support for task priorities.
• New Serializer abstraction allows users to customize the serialization
  format used when reading and writing tasks.
• Huey consumer and scheduler can be more easily run within the application
  process, if you prefer not to run a separate consumer process.
• Tasks can now specify an on_error handler, in addition to the
  previously-supported on_complete handler.
• Task pipelines return a special ResultGroup object which simplifies reading
  the results of a sequence of task executions.
• SqliteHuey has been promoted out of contrib, onto an equal footing with
  RedisHuey. To simplify deployment, the dependency on
  peewee was removed and the Sqlite
  storage engine uses the Python sqlite3 driver directly.