Additional CREATE PIPELINE Examples

Pipelines can be created using the SKIP, IGNORE, or REPLACE options. These options can be used alone or in combination with each other.

SKIP

The SKIP ... ERRORS behavior lets you specify an error scenario that, when encountered, discards an offending row. Refer to SKIP ALL ERRORS example for more information.

Examples

CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> SKIP PARSER ERRORS INTO TABLE <table_name>;
CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> SKIP PARSER ERRORS REPLACE INTO TABLE<table_name>;
CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> SKIP CONSTRAINT ERRORS INTO TABLE <table_name>;
CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> SKIP ALL ERRORS INTO TABLE <table_name>;

IGNORE

Unlike SKIP ... ERRORS which discards offending rows, IGNORE may change the inserted row’s data to ensure that it adheres to the table schema. Refer to IGNORE Error Handling for more information.

Examples

CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> IGNORE INTO TABLE <table_name>;
CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> IGNORE PARSER ERRORS INTO TABLE <table_name>;
CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> IGNORE PARSER ERRORS REPLACE INTO TABLE <table_name>;

REPLACE

If the REPLACE option is specified, existing rows in the table are replaced with the ingested row for each matching PRIMARY KEY or UNIQUE index.

REPLACE can also be used with IGNORE and SKIP. However, REPLACE can come after the SKIP or IGNORE option.

Examples

CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> REPLACE INTO TABLE <table_name>;
CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> SKIP ALL ERRORS REPLACE INTO TABLE <table_name>;
CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> SKIP CONSTRAINT ERRORS INTO TABLE <table_name>;
CREATE PIPELINE p AS LOAD DATA <file_name> SKIP CONSTRAINT ERRORS REPLACE INTO <pipeline_name>;

Important

  • SKIP CONSTRAINT ERRORS and SKIP DUPLICATE KEY ERRORS are unsupported with pipelines into stored procedures.

  • IGNORE, SKIP PARSER ERRORS, and SKIP ALL ERRORS are unsupported with non-CSV pipelines.

  • REPLACE, SKIP CONSTRAINT ERRORS, and SKIP DUPLICATE KEY ERRORS are supported with non-CSV pipelines.

Last modified:

Was this article helpful?