Additional CREATE PIPELINE Examples
On this page
Pipelines may be created using the SKIP, IGNORE, or REPLACE clauses.
SKIP
The SKIP .
Examples
CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> SKIP PARSER ERRORS INTO TABLE <table_name>;CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> SKIP PARSER ERRORS REPLACE INTO TABLE<table_name>;CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> SKIP CONSTRAINT ERRORS INTO TABLE <table_name>;CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> SKIP ALL ERRORS INTO TABLE <table_name>;
IGNORE
Unlike SKIP .IGNORE may change the inserted row’s data to ensure that it adheres to the table schema.
Examples
CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> IGNORE INTO TABLE <table_name>;CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> IGNORE PARSER ERRORS INTO TABLE <table_name>;CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> IGNORE PARSER ERRORS REPLACE INTO TABLE <table_name>;
REPLACE
If the REPLACE clause is specified, existing rows in the table are replaced with the ingested row for each matching PRIMARY KEY or UNIQUE index.
REPLACE may also be used with IGNORE and SKIP.REPLACE would come after the SKIP or IGNORE clause.
Examples
CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> REPLACE INTO TABLE <table_name>;CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> SKIP ALL ERRORS REPLACE INTO TABLE <table_name>;CREATE PIPELINE <pipeline_name> AS LOAD DATA <file_name> SKIP CONSTRAINT ERRORS INTO TABLE <table_name>;CREATE PIPELINE p AS LOAD DATA <file_name> SKIP CONSTRAINT ERRORS REPLACE INTO <pipeline_name>;
Important
-
SKIP CONSTRAINT ERRORSandSKIP DUPLICATE KEY ERRORSare unsupported with pipelines into stored procedures. -
IGNORE, SKIP PARSER ERRORS, andSKIP ALL ERRORSare unsupported with non-CSV pipelines. -
REPLACE, SKIP CONSTRAINT ERRORS, andSKIP DUPLICATE KEY ERRORSare supported with non-CSV pipelines.
Last modified: July 9, 2024