liteq

liteq is a lightweight message queue system for R that uses SQLite databases to store and manage job queues. It enables asynchronous task processing with support for multiple databases and multiple queues per database, requiring no separate server infrastructure.

The package provides automatic handling of crashed workers through SQLite’s locking mechanism, which can detect when a worker process dies and automatically requeue or mark failed messages. Messages can be acknowledged (ack) when successfully processed or negatively acknowledged (nack) when processing fails, giving precise control over job state management. The SQLite-based implementation makes queues portable and persistent across R sessions while maintaining process safety through built-in locking.