Aggregator Pipelines

Aggregator pipelines load data through the aggregator instead of directly to the leaves. Using this option can be more efficient for low parallelism pipelines, like single file S3 loads or single partition Kafka topics, and is required for pipelines into reference tables and tables with auto increment columns. A stored procedure cannot be used with an aggregator pipeline.

To create an aggregator pipeline, use CREATE AGGREGATOR PIPELINE.

Last modified: September 20, 2021

Was this article helpful?