Fleet.Queue.Pipeline (fleet v0.1.0)

Copy Markdown View Source

Broadway pipeline managing message execution for a specific Fleet queue.

Summary

Functions

Starts a Broadway pipeline for a single queue.

Functions

start_link(opts)

Starts a Broadway pipeline for a single queue.

Options

  • :name - Registration name for the Broadway process.
  • :repo - Ecto.Repo module or DBConnection process.
  • :queue - Queue name (string or atom).
  • :concurrency - Number of concurrent worker processor processes (default 10).
  • :producer_concurrency - Number of concurrent producer processes (default 1). When > 1, enables :coop mode automatically.
  • :batch_concurrency - Number of concurrent batcher processes when :batch_size is used (default 1).
  • :min_demand - Optional minimum processor demand.
  • :max_demand - Optional maximum processor demand.
  • :poll_interval - Polling interval in ms (default 1000).
  • :max_batch_size - Maximum messages fetched per poll (default 100).
  • :batch_size - Optional batch size for batch processing (chunks).
  • :batch_timeout - Optional batch timeout in ms (default 2000).