Important

Helios features are now enabled during weekly update windows and are no longer directly tied to SingleStore engine releases. Refer to the release notes to view the latest features available in your Helios cluster.

Aggregator Pipelines

Aggregator pipelines load data through the aggregator instead of loading data directly to the leaves. Using aggregator pipelines can improve efficiency for low parallelism pipelines, such as single file S3 loads or single partition Kafka topics, and it is required for pipelines that load data into reference tables and tables with auto increment columns.

Aggregator pipelines only support stored procedures for MongoDB and MySQL sources, i.e., CREATE AGGREGATOR PIPELINE ... AS LOAD DATA {MONGODB | MYSQL} statements.

To create an aggregator pipeline, use the CREATE AGGREGATOR PIPELINE command.

Last modified:

Was this article helpful?